-- Logs begin at Tue 2021-12-14 02:32:15 UTC, end at Tue 2021-12-14 03:38:26 UTC. -- Dec 14 03:06:32.479551 dv-cinder-818037-8-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Dec 14 03:06:35.292214 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.common.config [-] Logging enabled! Dec 14 03:06:35.292895 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev278 Dec 14 03:06:35.292986 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102430) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 14 03:06:35.296319 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.common.config [-] Logging enabled! Dec 14 03:06:35.296573 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev278 Dec 14 03:06:35.296884 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102430) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 14 03:06:35.297809 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:06:35.298040 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:06:35.298407 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:06:35.298649 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:06:35.298872 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:06:35.299237 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.299656 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 14 03:06:35.299964 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.300254 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.300545 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.300837 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.301123 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.301404 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.301691 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.301984 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.302266 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.302543 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.302824 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.303133 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.303413 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.303697 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.303984 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.304262 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] debug = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.304539 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.304969 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.305383 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.305659 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.305944 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.306222 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.306490 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.306759 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.307059 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.307380 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] host = dv-cinder-818037-8-iscsi {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.307655 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.307938 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.308218 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.308499 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.308770 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.309577 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.309859 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.310131 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.310400 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.310670 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.310953 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.311261 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.311545 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.311767 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.311987 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.312279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.312562 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.312834 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.313108 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.313382 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.313653 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.313923 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.314193 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.314475 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.314755 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.315063 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.315331 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.315603 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.315869 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.316138 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.316420 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.316689 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.316958 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.317227 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.317509 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.317774 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.318043 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.318340 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.318621 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.318899 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.319209 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.319480 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.319760 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.320027 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.320295 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.320573 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_json = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.320828 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.321096 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.321374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.321643 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.321909 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.322178 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.322443 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.322720 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:35.323011 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.323336 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.323620 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.323899 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.324208 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.324484 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.325337 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.325615 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.325902 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.326187 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.326472 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.326746 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.327028 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.327323 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.327615 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.327917 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.328208 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.328496 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.328768 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.329041 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.329311 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.329587 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.329871 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.330145 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.330429 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.330711 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.330986 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.331302 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.331583 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.331871 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.332158 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.332426 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.332700 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.332986 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.333260 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.333531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.333804 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.334091 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.334363 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.334632 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.334909 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.335208 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.335479 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.335747 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.336021 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.336306 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.336578 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.336846 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.337113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.337385 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.337654 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.337933 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.338205 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.338473 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.338741 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.339013 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.339303 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.339573 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.339846 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.340114 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.340432 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.340702 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.340973 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.341244 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.341517 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.341787 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.342058 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.342327 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.342602 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.342872 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.343168 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.343443 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.343716 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.343992 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.344275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.344569 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.344843 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.345116 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.345391 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.345664 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.345936 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.346209 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.346484 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.346758 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.347027 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.347331 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.347613 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.347896 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.348174 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.348465 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.348754 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.349028 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.349307 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.349581 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.349857 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.350136 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.350412 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.350700 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.350989 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.351301 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.351594 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.351881 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.352159 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.352461 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.352737 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:35.352951 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:06:35.353188 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102430) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 14 03:06:35.810701 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:35.810976 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:35.811307 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:35.811640 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 14 03:06:36.152168 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.152458 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.153275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.154552 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.154826 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.155111 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.199767 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.200041 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.200306 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.214043 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.214325 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.214593 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.243429 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.243706 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.243974 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.283569 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.283847 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.284115 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.616451 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.617082 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.617082 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.617266 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.617949 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.716547 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.716866 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.717150 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.717423 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.717688 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.717998 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.718262 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.718519 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.718773 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.719075 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.719340 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.719604 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.719859 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.720111 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.720367 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.720630 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.720885 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.721151 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.721419 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.721676 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.721947 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.722201 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.722481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.722855 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.723134 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.723382 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.723776 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.724009 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.724241 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.724472 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.724702 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.724932 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:36.725286 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 14 03:06:36.728402 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 14 03:06:36.732455 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 14 03:06:36.736352 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(250, 299)])]) Dec 14 03:06:36.738238 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 14 03:06:36.738697 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 14 03:06:36.739026 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 14 03:06:36.739426 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 14 03:06:36.742234 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 14 03:06:36.742487 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 14 03:06:36.742831 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 14 03:06:36.748660 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 14 03:06:36.771837 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 14 03:06:36.772281 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.772579 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102430) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 14 03:06:36.772938 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.774308 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102430) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 14 03:06:36.774585 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 14 03:06:36.774826 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 14 03:06:36.778078 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.778367 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:36.841561 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 14 03:06:36.841802 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 14 03:06:36.842035 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 14 03:06:36.842399 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 14 03:06:36.863526 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_db.sqlalchemy.engines [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:37.289130 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing driver for type 'gre' Dec 14 03:06:37.289713 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] gre ID ranges: [(1, 1000)] Dec 14 03:06:37.343275 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing driver for type 'local' Dec 14 03:06:37.343605 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing driver for type 'vlan' Dec 14 03:06:37.355972 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] VlanTypeDriver initialization complete Dec 14 03:06:37.356375 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing driver for type 'vxlan' Dec 14 03:06:37.356830 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] vxlan ID ranges: [(1, 1000)] Dec 14 03:06:37.405014 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing extension driver 'port_security' Dec 14 03:06:37.405345 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.extensions.port_security [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] PortSecurityExtensionDriver initialization complete Dec 14 03:06:37.405680 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing mechanism driver 'openvswitch' Dec 14 03:06:37.406021 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing mechanism driver 'hyperv' Dec 14 03:06:37.412664 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.plugin [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102430) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:37.413500 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.413879 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.414243 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.414779 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.415252 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.415617 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.415973 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.416380 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.416794 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.417151 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.417501 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.417904 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.418319 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.418679 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.419025 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.419458 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.419876 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.420238 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.420586 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.420990 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.421400 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > address_group after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.421754 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > address_group after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.422100 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.422502 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102430) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 14 03:06:37.422890 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] ML2 OVO RPC backend initialized. {{(pid=102430) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 14 03:06:37.423634 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.424000 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.424427 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.424782 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > networks before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.425141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.425493 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > ports before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.425846 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.426195 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnets before_response 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.426549 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.426898 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.427275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.427628 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.427993 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.428322 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.428670 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.429015 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.429358 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.429942 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.plugin [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Modular L2 Plugin initialization complete Dec 14 03:06:37.430314 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading services supported by the core plugin {{(pid=102430) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 14 03:06:37.430645 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.plugins.ml2.managers [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Got port-security extension from driver 'port_security' Dec 14 03:06:37.431144 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.extensions.vlantransparent [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Disabled vlantransparent extension. Dec 14 03:06:37.431628 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102430) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 14 03:06:37.431945 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: router Dec 14 03:06:37.468990 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.469372 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_create 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.469752 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router before_create 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.470126 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.470505 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.470866 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_delete 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.471258 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.471741 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.472110 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_create 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.472465 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.472820 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.473176 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.473542 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.473961 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.474337 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.474684 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.475032 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: subnet after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.475396 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.475752 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.476106 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_create 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.476456 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.476805 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.477169 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router after_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.477521 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.477880 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_create 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.478249 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.478610 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_update 55549900 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.478984 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > agent after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.479376 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > agent after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.479731 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > network after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.480591 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Tracking information for resource: router configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:37.481481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Tracking information for resource: floatingip configured {{(pid=102430) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 14 03:06:37.486418 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.db.l3_agentschedulers_db [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 14 03:06:37.486995 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.487639 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.488001 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.488368 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: port after_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.489164 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router before_create 55550100 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.489537 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.489908 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_create 55550100 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.490274 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > router precommit_update 55550100 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.495255 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.provider_configuration [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service providers = [] {{(pid=102430) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 14 03:06:37.495626 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.db.servicetype_db [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102430) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 14 03:06:37.498626 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.service_base [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102430) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 14 03:06:37.498986 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.service_base [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102430) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 14 03:06:37.499361 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.service_base [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102430) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 14 03:06:37.500260 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.services.service_base [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102430) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 14 03:06:37.500639 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.services.service_base [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 14 03:06:37.501018 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.501340 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 14 03:06:37.512225 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.512568 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: auto_allocate Dec 14 03:06:37.518361 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: network precommit_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.518733 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: network precommit_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.519296 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.519622 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: tag Dec 14 03:06:37.526367 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.526704 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: timestamp Dec 14 03:06:37.531182 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.531518 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: network_ip_availability Dec 14 03:06:37.537018 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.537395 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.537758 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.538474 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.538803 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: flavors Dec 14 03:06:37.544495 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.544784 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading Plugin: revisions Dec 14 03:06:37.549165 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102430) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 14 03:06:37.549562 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.738s {{(pid=102430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:37.550308 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102430) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 14 03:06:37.550649 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Initializing extension manager. Dec 14 03:06:37.551207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: __init__.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.551556 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: __pycache__ {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.551896 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.552234 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: address_group.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.552997 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.553561 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: address-group Dec 14 03:06:37.553892 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: address_scope.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.554620 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.555168 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: address-scope Dec 14 03:06:37.555499 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.556445 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.556958 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: router-admin-state-down-before-update Dec 14 03:06:37.557286 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: agent.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.558001 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.558512 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: agent Dec 14 03:06:37.558869 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: agent_resources_synced.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.559829 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.560345 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: agent-resources-synced Dec 14 03:06:37.560675 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: allowedaddresspairs.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.562483 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.563016 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: allowed-address-pairs Dec 14 03:06:37.563384 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: auto_allocated_topology.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.564477 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.565004 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: auto-allocated-topology Dec 14 03:06:37.565340 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: availability_zone.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.566050 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.566567 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: availability_zone Dec 14 03:06:37.566900 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: availability_zone_filter.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.567863 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.568383 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: availability_zone_filter Dec 14 03:06:37.568721 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: data_plane_status.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.569648 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.570164 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension data-plane-status not supported by any of loaded plugins Dec 14 03:06:37.570498 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: default_subnetpools.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.571460 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.571978 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: default-subnetpools Dec 14 03:06:37.572307 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.573118 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.573631 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: dhcp_agent_scheduler Dec 14 03:06:37.573961 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: dns.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.574922 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.575492 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension dns-integration not supported by any of loaded plugins Dec 14 03:06:37.575824 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: dns_domain_ports.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.576756 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.577268 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 14 03:06:37.577598 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.578554 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.579088 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 14 03:06:37.579423 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: dvr.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.580106 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.580614 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: dvr Dec 14 03:06:37.580942 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: ecmp_routes.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.581875 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.582385 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension ecmp_routes not supported by any of loaded plugins Dec 14 03:06:37.582713 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: empty_string_filtering.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.583672 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.584185 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: empty-string-filtering Dec 14 03:06:37.584510 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.585437 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.585945 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 14 03:06:37.586273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.587232 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.587741 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 14 03:06:37.588068 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: external_net.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.589002 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.589515 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: external-net Dec 14 03:06:37.589842 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.591341 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.591856 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: extra_dhcp_opt Dec 14 03:06:37.592187 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: extraroute.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.593116 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.593636 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: extraroute Dec 14 03:06:37.593965 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: extraroute_atomic.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.596460 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.597004 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: extraroute-atomic Dec 14 03:06:37.597343 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: filter_validation.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.598033 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.598551 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: filter-validation Dec 14 03:06:37.598885 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: fip_pf_description.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.599873 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.600391 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 14 03:06:37.600723 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: fip_port_details.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.601662 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.602183 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: fip-port-details Dec 14 03:06:37.602516 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: flavors.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.603821 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.604350 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: flavors Dec 14 03:06:37.604687 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.606952 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.607513 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 14 03:06:37.607848 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: floatingip_pools.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.608560 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.609083 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: floatingip-pools Dec 14 03:06:37.609413 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: ip_allocation.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.610356 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.610873 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension ip_allocation not supported by any of loaded plugins Dec 14 03:06:37.611232 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.612427 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.612943 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: ip-substring-filtering Dec 14 03:06:37.613277 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l2_adjacency.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.614226 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.614737 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension l2_adjacency not supported by any of loaded plugins Dec 14 03:06:37.615090 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.616060 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.616579 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: router Dec 14 03:06:37.617097 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.619252 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.619797 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 14 03:06:37.620140 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.621094 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.621651 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: ext-gw-mode Dec 14 03:06:37.621988 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.622952 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.623501 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: l3-ha Dec 14 03:06:37.623836 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3_flavors.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.624779 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.625300 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: l3-flavors Dec 14 03:06:37.625632 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.626564 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.627109 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: l3-port-ip-change-not-allowed Dec 14 03:06:37.627444 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: l3agentscheduler.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.628481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.628999 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: l3_agent_scheduler Dec 14 03:06:37.629336 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: local_ip.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.631218 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.631752 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension local_ip not supported by any of loaded plugins Dec 14 03:06:37.632096 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: logging.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.633602 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.634132 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension logging not supported by any of loaded plugins Dec 14 03:06:37.634473 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: metering.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.635389 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.635977 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: metering Dec 14 03:06:37.636315 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.637464 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.637986 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: metering_source_and_destination_fields Dec 14 03:06:37.638322 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: multiprovidernet.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.639333 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.639857 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: multi-provider Dec 14 03:06:37.640186 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: netmtu.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.641124 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.641638 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: net-mtu Dec 14 03:06:37.641970 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: netmtu_writable.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.642901 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.643443 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: net-mtu-writable Dec 14 03:06:37.643777 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: network_availability_zone.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.644458 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.644969 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: network_availability_zone Dec 14 03:06:37.645295 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: network_ip_availability.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.646437 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.646960 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: network-ip-availability Dec 14 03:06:37.647321 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: network_segment_range.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.648105 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.648617 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension network-segment-range not supported by any of loaded plugins Dec 14 03:06:37.648946 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: pagination.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.649951 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.650292 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: pagination Dec 14 03:06:37.650619 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: port_device_profile.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.651568 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.652093 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: port-device-profile Dec 14 03:06:37.652425 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.653896 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.654415 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: port-mac-address-regenerate Dec 14 03:06:37.654747 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.655721 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.656242 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: port-numa-affinity-policy Dec 14 03:06:37.656569 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: port_resource_request.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.657523 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.658036 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension port-resource-request not supported by any of loaded plugins Dec 14 03:06:37.658367 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: port_resource_request_groups.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.659398 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.659917 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 14 03:06:37.660251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: portbindings.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.661200 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.661719 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: binding Dec 14 03:06:37.662048 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: portbindings_extended.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.663388 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.663915 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: binding-extended Dec 14 03:06:37.664255 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: portsecurity.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.665195 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.665718 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: port-security Dec 14 03:06:37.666051 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: project_id.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.667064 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.667481 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: project-id Dec 14 03:06:37.667812 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: providernet.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.669394 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.669927 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: provider Dec 14 03:06:37.670260 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.673863 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.674403 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos not supported by any of loaded plugins Dec 14 03:06:37.674743 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.676034 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.676566 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 14 03:06:37.676902 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.677846 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.678368 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 14 03:06:37.678700 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_default.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.679668 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.680192 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-default not supported by any of loaded plugins Dec 14 03:06:37.680524 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_fip.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.681190 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.681697 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-fip not supported by any of loaded plugins Dec 14 03:06:37.682026 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_fip_network_policy.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.683068 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension file qos_fip_network_policy.py wasn't loaded due to cannot import name 'qos_fip_network_policy' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Dec 14 03:06:37.683405 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_gateway_ip.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.684369 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.684884 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 14 03:06:37.685217 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_port_network_policy.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.686153 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.686673 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 14 03:06:37.687002 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.688211 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.688733 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 14 03:06:37.689065 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_pps_rule.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.690275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.690800 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-pps not supported by any of loaded plugins Dec 14 03:06:37.691161 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_rule_type_details.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.692106 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.692624 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 14 03:06:37.692991 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: qos_rules_alias.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.694046 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.694568 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 14 03:06:37.694897 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: quota_check_limit.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.695856 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.696376 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: quota-check-limit Dec 14 03:06:37.696708 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: quotasv2.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.697668 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.698000 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: quotas Dec 14 03:06:37.698328 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: quotasv2_detail.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.701563 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.701909 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: quota_details Dec 14 03:06:37.702249 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: rbac.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.703360 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.703896 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: rbac-policies Dec 14 03:06:37.704232 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: rbac_address_group.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.705193 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.705720 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: rbac-address-group Dec 14 03:06:37.706052 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: rbac_address_scope.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.706996 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.707547 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: rbac-address-scope Dec 14 03:06:37.707879 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: rbac_security_groups.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.708814 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.709343 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: rbac-security-groups Dec 14 03:06:37.709682 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: rbac_subnetpool.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.710615 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.711172 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: rbac-subnetpool Dec 14 03:06:37.711503 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: revisionifmatch.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.712449 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.712968 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: revision-if-match Dec 14 03:06:37.713299 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: revisions.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.714435 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.714962 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: standard-attr-revisions Dec 14 03:06:37.715855 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: router_availability_zone.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.716544 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.717061 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: router_availability_zone Dec 14 03:06:37.717393 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: routerservicetype.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.718331 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.718849 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension router-service-type not supported by any of loaded plugins Dec 14 03:06:37.719212 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.720253 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.720774 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: security-groups-normalized-cidr Dec 14 03:06:37.721107 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.722056 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.722576 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: port-security-groups-filtering Dec 14 03:06:37.722905 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.723876 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.724398 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: security-groups-remote-address-group Dec 14 03:06:37.724730 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.725686 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.726212 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: security-groups-shared-filtering Dec 14 03:06:37.726548 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.727172 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 14 03:06:37.727503 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: securitygroup.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.738159 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.738699 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: security-group Dec 14 03:06:37.739067 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: segment.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.739871 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.740399 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension segment not supported by any of loaded plugins Dec 14 03:06:37.740732 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.741691 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.742212 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 14 03:06:37.742546 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: servicetype.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.743705 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.744240 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: service-type Dec 14 03:06:37.744575 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: sorting.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.745587 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.745929 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: sorting Dec 14 03:06:37.746262 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: standard_attr_segment.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.747248 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.747891 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 14 03:06:37.748224 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: standardattrdescription.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.748890 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.749418 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: standard-attr-description Dec 14 03:06:37.749751 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: stateful_security_group.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.750730 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.751292 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: stateful-security-group Dec 14 03:06:37.751629 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: stdattrs_common.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.752213 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 14 03:06:37.752546 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.753512 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.754047 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 14 03:06:37.754379 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnet_onboard.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.755514 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.756042 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: subnet_onboard Dec 14 03:06:37.756374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.757318 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.757833 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 14 03:06:37.758163 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnet_service_types.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.759137 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.759657 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: subnet-service-types Dec 14 03:06:37.759984 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnetallocation.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.761093 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.761615 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: subnet_allocation Dec 14 03:06:37.762471 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.763185 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.763703 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: subnetpool-prefix-ops Dec 14 03:06:37.764032 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.764983 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.765501 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 14 03:06:37.765834 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: tagging.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.766913 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.767456 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: standard-attr-tag Dec 14 03:06:37.767800 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: timestamp.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.769014 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.769542 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loaded extension: standard-attr-timestamp Dec 14 03:06:37.769878 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: trunk.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.770951 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.771502 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension trunk not supported by any of loaded plugins Dec 14 03:06:37.771840 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: trunk_details.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.772779 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.773303 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension trunk-details not supported by any of loaded plugins Dec 14 03:06:37.773635 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: uplink_status_propagation.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.774579 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.775125 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 14 03:06:37.775462 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Loading extension file: vlantransparent.py {{(pid=102430) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 14 03:06:37.776140 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102430) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 14 03:06:37.776658 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extension vlan-transparent not supported by any of loaded plugins Dec 14 03:06:37.779827 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:network Dec 14 03:06:37.780364 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnet Dec 14 03:06:37.780778 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnetpool Dec 14 03:06:37.781176 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:port Dec 14 03:06:37.782423 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.782868 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service FLAVORS assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.783527 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.783962 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.784301 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:router Dec 14 03:06:37.784728 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:floatingip Dec 14 03:06:37.785213 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service METERING assigned prefix: /metering {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.786649 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.787024 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.787412 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102430) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:06:37.788410 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of CountableResource for resource:rbac_policy Dec 14 03:06:37.788869 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:security_group Dec 14 03:06:37.789308 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 14 03:06:37.789932 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service CORE assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.790272 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnetpool Dec 14 03:06:37.790628 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] subnetpool is already registered Dec 14 03:06:37.791100 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service CORE assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.791437 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnetpool Dec 14 03:06:37.791777 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] subnetpool is already registered Dec 14 03:06:37.794049 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.794489 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service FLAVORS assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.795171 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.795543 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.795882 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:router Dec 14 03:06:37.796231 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] router is already registered Dec 14 03:06:37.796645 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:floatingip Dec 14 03:06:37.796989 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] floatingip is already registered Dec 14 03:06:37.797446 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service METERING assigned prefix: /metering {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.798111 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of CountableResource for resource:rbac_policy Dec 14 03:06:37.798444 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] rbac_policy is already registered Dec 14 03:06:37.798859 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:security_group Dec 14 03:06:37.799240 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] security_group is already registered Dec 14 03:06:37.799647 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 14 03:06:37.799987 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] security_group_rule is already registered Dec 14 03:06:37.800632 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service CORE assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.800966 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnetpool Dec 14 03:06:37.801307 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] subnetpool is already registered Dec 14 03:06:37.801731 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.v2.resource_helper [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Service CORE assigned prefix: {{(pid=102430) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 14 03:06:37.802059 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Creating instance of TrackedResource for resource:subnetpool Dec 14 03:06:37.802396 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING neutron.quota.resource_registry [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] subnetpool is already registered Dec 14 03:06:37.802863 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: extensions {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.804365 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: address-groups {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.805869 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: address-scopes {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.807254 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: agents {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.808432 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: auto-allocated-topology {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.809741 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: availability_zones {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.810987 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: dhcp-networks {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.812532 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: dhcp-agents {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.813990 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: routers {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.816247 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: flavors {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.817426 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: service_profiles {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.818661 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: next_providers {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.820157 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: service_profiles {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.822687 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: floatingip-pools {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.823998 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: routers {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.826693 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: floatingips {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.828045 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: l3-routers {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.829450 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: l3-agents {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.830897 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: metering-labels {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.832307 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: metering-label-rules {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.833602 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: network-ip-availabilities {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.834902 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: bindings {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.836601 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: quotas {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.838245 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: quotas {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.839829 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: rbac-policies {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.841761 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: security-groups {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.843017 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: security-group-rules {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.844308 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: service-providers {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.845549 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: subnetpools {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.846992 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: subnetpools {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.848488 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.850169 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.852039 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.853849 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.855688 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.857588 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.859330 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.861299 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.863397 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.865254 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron.api.extensions [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Extended resource: tags {{(pid=102430) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 14 03:06:37.871331 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING keystonemiddleware.auth_token [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:06:37.876026 dv-cinder-818037-8-iscsi neutron-server[102430]: WARNING keystonemiddleware.auth_token [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:06:37.884900 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Acquired lock "singleton_lock" {{(pid=102430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 14 03:06:37.885372 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_concurrency.lockutils [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Releasing lock "singleton_lock" {{(pid=102430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 14 03:06:37.886037 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Starting 2 workers Dec 14 03:06:37.891500 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Started child 102571 {{(pid=102430) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 14 03:06:37.895935 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Started child 102572 {{(pid=102430) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 14 03:06:37.896785 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.897469 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO neutron.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Neutron service started, listening on 0.0.0.0:9696 Dec 14 03:06:37.898130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Publish callbacks [] for process, before_spawn {{(pid=102430) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.898304 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [-] (102571) wsgi starting up on http://0.0.0.0:9696 Dec 14 03:06:37.900584 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Starting 1 workers Dec 14 03:06:37.900861 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.902304 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [-] (102572) wsgi starting up on http://0.0.0.0:9696 Dec 14 03:06:37.906463 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Started child 102573 {{(pid=102430) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 14 03:06:37.907008 dv-cinder-818037-8-iscsi neutron-server[102430]: INFO oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Starting 1 workers Dec 14 03:06:37.910316 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] calling RpcWorker wait() {{(pid=102573) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 14 03:06:37.910867 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] returning from RpcWorker wait() {{(pid=102573) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 14 03:06:37.911536 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Started child 102574 {{(pid=102430) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 14 03:06:37.912555 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.912650 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG neutron_lib.callbacks.manager [None req-b36920b7-fe1c-495c-9e90-419201251a85 None None] Publish callbacks [] for process, after_spawn {{(pid=102430) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.913068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:37.914408 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102430) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 14 03:06:37.914616 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:06:37.914807 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:06:37.915056 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:06:37.915409 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:06:37.915595 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:06:37.916105 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.916402 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.916659 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.916754 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:37.917183 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.917250 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.917822 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.918069 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.918379 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.918664 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.918901 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.919094 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.919272 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.919536 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.919773 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.920098 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.920368 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.920623 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.920874 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.921051 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.921309 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.921568 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.921802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.922073 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] debug = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.922324 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.922835 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.923088 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.923338 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.923553 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.923852 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.924083 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.924362 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.924606 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.924826 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.925066 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.925332 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.925593 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.925827 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.926065 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.926302 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.926554 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.926776 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.927285 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] host = dv-cinder-818037-8-iscsi {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.927529 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.927770 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.928019 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.928266 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.928522 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.928762 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.929020 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.929291 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.929518 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.929748 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.929993 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.930265 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.930503 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.930757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.930922 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_options = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.931197 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.931477 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.931744 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.931942 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.932112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.932293 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.932553 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.932720 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.932985 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.933222 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.933437 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.933652 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.933941 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.934186 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.934445 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.934713 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.934897 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.935131 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.935380 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.935642 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.935888 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.936117 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.936358 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.936578 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.936801 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.937039 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.937286 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.937518 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.937754 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.937988 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.938232 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.938475 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.938709 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.938950 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.939236 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.939487 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.939719 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.939952 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.940223 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.940449 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.940700 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.940947 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.941162 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.941422 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.941655 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.941902 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.942151 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_json = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.942369 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.942604 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.942855 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.943096 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.943318 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.943532 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.943746 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.944018 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:37.944435 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.944709 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946748 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.946880 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:37.947021 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.947021 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.947021 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.947397 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.947525 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.947745 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.948006 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.948353 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.949341 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.949341 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.949341 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.950114 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.950228 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.950635 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.951089 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.951338 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.951745 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.951988 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.952247 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.952536 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.952837 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.953152 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.953815 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.953815 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.43/identity {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.954072 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.957113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.960757 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.961660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963275 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.963980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.967279 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.968455 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.969273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.969273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.969273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.969273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971207 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971772 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971772 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.971772 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.972419 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.972419 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.972419 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.973531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.973531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.973531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.973531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.973531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.975251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976067 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976067 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976067 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976609 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976609 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.976896 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.977032 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.977497 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.977497 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.977746 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.978175 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.978316 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.978477 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.978696 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.979481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.979481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.979870 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.979870 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.980103 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.980224 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.980638 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.980823 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.981231 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.981231 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.981470 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.981635 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.981888 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.43/identity {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.982393 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.982393 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.982677 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.982786 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.983026 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.983274 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.983499 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.983714 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.983961 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.984191 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.984408 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.984662 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.984857 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.985134 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.985323 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.985576 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.985790 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.986012 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.986442 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.986442 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.986830 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.987795 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.987795 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.987795 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.989130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.992802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993983 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993983 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.993983 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.994188 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.994537 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.994537 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.994752 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.994993 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.995432 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.995682 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.995939 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.996173 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.996416 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.996624 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.996864 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.997268 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.997764 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.998198 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.998633 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.999085 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.999503 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:37.999941 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.000178 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.000398 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.000615 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.000841 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.001067 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.001285 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.001514 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.001728 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.001945 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.002170 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.002390 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.002659 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.002887 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.003152 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.003386 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.003600 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.003999 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.004388 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.004811 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.005297 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.005747 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.006043 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.006324 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.006594 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.006880 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.007203 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.007502 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.007793 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.008076 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.008351 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.008651 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.009068 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.009448 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.009741 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.009997 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.010254 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.010498 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.010820 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.011091 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.011335 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.011588 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.011843 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.012604 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.012863 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.013189 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.013478 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.013738 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.013974 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.014256 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.014531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:250:299'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.014802 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.015020 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.015333 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.015690 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.015961 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.016225 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.016473 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.016727 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.016980 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.017219 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.017472 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.017710 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.017930 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.018192 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.018426 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.018656 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.018873 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.019123 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.019343 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.019586 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.019818 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.020041 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.020256 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.020409 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:06:38.021235 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102430) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 14 03:06:38.021235 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:06:38.021235 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:06:38.021644 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:06:38.021644 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:06:38.021913 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:06:38.021913 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022166 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022166 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022420 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022555 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022689 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022837 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.022981 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023148 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023283 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023417 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023581 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023749 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.023888 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024050 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024210 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024372 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024531 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024696 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.024853 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.025166 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.025332 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.025493 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] debug = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.025652 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.025862 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026026 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026186 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026346 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026507 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026668 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026827 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.026986 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.027173 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.027333 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.027479 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028251 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028391 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028514 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028656 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028815 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.028975 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029134 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] host = dv-cinder-818037-8-iscsi {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029293 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029452 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029609 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029768 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.029927 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030086 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030245 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030585 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030585 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030861 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.030861 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031165 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031165 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031434 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031434 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_options = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031705 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031842 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.031979 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032114 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032257 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032379 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032539 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032700 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.032861 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033021 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033180 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033338 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033496 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033721 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033858 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.033981 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034104 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034253 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034411 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034559 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034899 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.034899 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035209 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035209 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035470 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035470 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035739 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.035874 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036009 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036155 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036292 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036436 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036574 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036704 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036834 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.036973 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037108 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037244 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037393 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037530 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037674 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037842 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.037979 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.038114 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.038259 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.038481 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.038626 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_json = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.038762 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039121 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039121 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039121 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039504 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039504 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039737 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039737 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:38.039969 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040090 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040222 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040384 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040546 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040732 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.040868 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041003 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041164 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041318 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041465 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041629 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041725 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:38.041811 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.041952 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042113 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042280 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042442 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042605 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042768 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.042930 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043125 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043312 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043486 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043650 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043817 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.043978 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044139 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044310 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044472 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044649 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044811 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.044975 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.43/identity {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045137 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045347 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045473 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045623 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045785 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.045948 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046111 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046274 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046438 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046601 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046762 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.046926 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047277 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047441 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047605 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047768 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.047930 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048093 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048260 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048421 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048585 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048746 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.048910 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049074 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049244 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049405 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049566 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049728 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.049889 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050051 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050214 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050376 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050536 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050775 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.050876 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051005 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051196 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051360 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051523 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051685 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.051852 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052028 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052167 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052309 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052469 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052633 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052796 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.052959 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.053123 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.053550 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.053550 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.053792 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.053792 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054374 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054826 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054826 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.054826 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055376 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055376 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055376 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055709 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055709 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.055709 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056046 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056046 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056325 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056325 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056770 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056770 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.056770 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057352 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057352 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057554 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057655 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057816 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.057978 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058139 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058299 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058463 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058652 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058814 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.058973 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059141 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059297 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059469 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059641 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059807 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.059972 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060133 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060295 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060456 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060617 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060795 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.060932 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061243 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061416 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061579 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061743 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.061905 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062090 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062252 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062418 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062580 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062740 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.062902 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063083 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063248 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063410 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063571 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063733 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.063897 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.43/identity {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064059 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064273 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064396 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064520 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064672 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.064835 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065167 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065167 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065402 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065484 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065594 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065754 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.065915 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066078 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066241 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066403 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066564 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066726 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.066888 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067059 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067232 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067393 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067554 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067715 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.067876 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068040 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068200 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068363 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068525 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068687 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.068848 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069011 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069174 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069335 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069497 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069660 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069822 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.069985 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070148 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070311 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070473 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070634 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070795 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.070996 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071156 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071320 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071482 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071647 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071807 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.071969 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072130 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072297 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072458 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072619 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072784 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.072948 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073112 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073274 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073438 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073623 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073752 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.073913 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.074087 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.074301 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.074913 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075100 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075264 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075427 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075599 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075760 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.075922 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076085 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076246 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076408 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076578 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076739 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.076901 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077063 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077212 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077372 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077542 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077704 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.077864 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078026 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078186 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078346 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078516 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078677 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078837 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.078999 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.079184 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.079345 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.079516 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.079677 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.079838 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080000 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080160 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080320 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080490 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080653 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080815 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.080987 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081192 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081302 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081465 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081638 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081801 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.081965 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.082127 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.082288 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.082655 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.082655 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.082882 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083305 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083305 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083305 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083638 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083638 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:250:299'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083831 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.083918 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084033 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084206 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084368 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084530 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084693 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.084854 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085016 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085176 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085339 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085681 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085681 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085876 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.085953 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086094 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086255 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086416 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086578 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086739 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.086901 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.087253 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.087253 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:38.087493 dv-cinder-818037-8-iscsi neutron-server[102430]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:06:38.152751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46196) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:06:38.161478 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [-] 10.222.0.43 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064890 Dec 14 03:06:49.657579 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98d6aa28-5f17-4071-98ea-897ea0ad1e91 None None] get_active_networks_info from dv-cinder-818037-8-iscsi {{(pid=102573) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 14 03:06:49.770870 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98d6aa28-5f17-4071-98ea-897ea0ad1e91 None None] No non-hosted networks {{(pid=102573) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 14 03:06:49.800496 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.agentschedulers_db [None req-98d6aa28-5f17-4071-98ea-897ea0ad1e91 None None] DHCP Agent not found on host dv-cinder-818037-8-iscsi {{(pid=102573) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Dec 14 03:06:49.979322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-cba7b68d-0e08-40d2-8bf5-c8ea1a0bb6dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:51.825792 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-798d2a89-e7d7-49a8-9f80-bf816682d9a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:51.877875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-83b4d278-4ab0-48fa-9bf4-e59258d3c2fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:53.567099 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:54.574910 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:54.811162 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.db.l3_hamode_db [None req-1175afbb-395a-4992-8967-47c722a87063 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 14 03:06:54.888704 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1175afbb-395a-4992-8967-47c722a87063 None None] Routers set() bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:06:54.889097 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1175afbb-395a-4992-8967-47c722a87063 None None] Router IDs set() for agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 14 03:06:55.744877 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:55.745690 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.745895 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.746205 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.746534 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.746863 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.747225 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.747552 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.747892 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.748296 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.748636 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.748967 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.749297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.749639 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:06:55.750012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-818037-8-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:55.756002 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-818037-8-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:06:55.974242 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46290) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:06:56.477652 dv-cinder-818037-8-iscsi neutron-server[102572]: WARNING oslo_policy.policy [None req-e5f23193-a9de-407d-b0bb-05c156ee1b82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:06:56.478260 dv-cinder-818037-8-iscsi neutron-server[102572]: WARNING oslo_policy.policy [None req-e5f23193-a9de-407d-b0bb-05c156ee1b82 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:06:56.703997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [None req-e5f23193-a9de-407d-b0bb-05c156ee1b82 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:06:56.705022 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e5f23193-a9de-407d-b0bb-05c156ee1b82 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7298641 Dec 14 03:06:59.283989 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46306) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:06:59.584881 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] Request body: {'subnetpool': {'shared': True, 'default_prefixlen': 26, 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:06:59.679825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.policy [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102572) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 14 03:06:59.726688 dv-cinder-818037-8-iscsi neutron-server[102572]: WARNING oslo_policy.policy [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:06:59.727107 dv-cinder-818037-8-iscsi neutron-server[102572]: WARNING oslo_policy.policy [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:06:59.735547 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.quota [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] Loaded quota_driver: . Dec 14 03:06:59.822042 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911775658', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911780437', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911793962', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911796951', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911790229', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8763911877362', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3640460', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3652492', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-491470', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-646171'] for rbac-policy, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:59.885577 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:06:59.886764 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-53c27515-84cf-467c-91b3-ad84291900c9 admin admin] 10.222.0.43 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6017938 Dec 14 03:07:02.646811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46318) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:02.939387 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Request body: {'network': {'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'name': 'private'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:02.967330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Made reservation on behalf of d7f09e72d52d44edad5f503d25ed1815 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:07:02.969981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:02.986670 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.089162 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.093094 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.111514 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 265} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:07:03.139699 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8763912245625', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.140267 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Unsubscribe: segment precommit_create {{(pid=102572) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 14 03:07:03.140765 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Added segment f4ff8000-fd7d-41fd-9759-68872ca0eb6b of type vlan for network d6406fe1-3247-4e1c-bf97-36524d134d9d Dec 14 03:07:03.157409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f2a3ed3-c614-489d-a3cc-ef10d113228c,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:03.205430 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.205786 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.206121 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.206449 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.206774 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.207119 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.207453 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.207777 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.208107 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.208439 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.208757 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.209067 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.209378 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Tracked resource versions report: Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: pushed versions: Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: { 'AddressGroup': {'1.2'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'ConntrackHelper': {'1.0'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Log': {'1.0'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Network': {'1.1'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Port': {'1.7'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'PortForwarding': {'1.2'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'QosPolicy': {'1.10'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroup': {'1.5'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SubPort': {'1.0'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Subnet': {'1.1'}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Trunk': {'1.1'}} Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: consumer versions: Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'ConntrackHelper': '1.0', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'LocalIPAssociation': '1.0', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Log': '1.0', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Network': '1.1', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Port': '1.7', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'PortForwarding': '1.2', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'QosPolicy': '1.10', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroup': '1.5', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroupRule': '1.2', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SubPort': '1.0', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Subnet': '1.1', Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Trunk': '1.1'}} Dec 14 03:07:03.210712 dv-cinder-818037-8-iscsi neutron-server[102572]: {{(pid=102572) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:07:03.251862 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.293622 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.294732 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:03.295476 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:03.370517 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7219384 Dec 14 03:07:03.394466 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d350ed7a-ea07-404a-acd8-2dc32f121f25 admin admin] Pushing event updated for resources: {'Network': ['ID=d6406fe1-3247-4e1c-bf97-36524d134d9d,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:03.406875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network d6406fe1-3247-4e1c-bf97-36524d134d9d details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:07:06.213863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46332) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:06.606673 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-179afa82-462a-41ef-bde5-aa2f238d4caf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:06.608059 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-179afa82-462a-41ef-bde5-aa2f238d4caf admin admin] 10.222.0.43 "GET /v2.0/networks/d6406fe1-3247-4e1c-bf97-36524d134d9d HTTP/1.1" status: 200 len: 825 time: 0.3927114 Dec 14 03:07:06.632531 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8c54437d-e254-47c4-8a73-33fc66b17aa5 admin admin] 10.222.0.43 "GET /v2.0/subnetpools/126dec19-adb4-4f78-986f-077b226d9b25 HTTP/1.1" status: 200 len: 734 time: 0.0182400 Dec 14 03:07:06.641957 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Request body: {'subnet': {'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25', 'ip_version': 4, 'name': 'private-subnet', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'gateway_ip': '172.20.0.1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:06.663825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Made reservation on behalf of d7f09e72d52d44edad5f503d25ed1815 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:07:06.666089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:06.958227 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:07.024882 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a4204a1-e02e-4d1f-8360-084996a625bb,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:07.027418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Checking segment: {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:07:07.027804 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Network hostable DHCP agents. Network: d6406fe1-3247-4e1c-bf97-36524d134d9d, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:07:07.048593 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Network d6406fe1-3247-4e1c-bf97-36524d134d9d is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:07:07.067262 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, d6406fe1-3247-4e1c-bf97-36524d134d9d) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:07.072022 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:07.072600 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:07.077264 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8288df59-e313-4ba6-bcfc-bf1bb14e0dab None None] Network d6406fe1-3247-4e1c-bf97-36524d134d9d requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:07:07.088532 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-bfbc490b-ac64-4eac-befc-2ea6b549ce11 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4497113 Dec 14 03:07:07.340970 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-d6406fe1-3247-4e1c-bf97-36524d134d9d', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:07:07.342177 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:07.639168 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Allocated IP 172.20.0.2 (d6406fe1-3247-4e1c-bf97-36524d134d9d/2a4204a1-e02e-4d1f-8360-084996a625bb/ac09b704-afe3-4e62-adb9-44c81b551185) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:07:07.879482 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:07.888304 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:07.963202 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Network d6406fe1-3247-4e1c-bf97-36524d134d9d is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:07:07.968643 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:07.977081 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:07:07.980754 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Pushing event updated for resources: {'Port': ['ID=ac09b704-afe3-4e62-adb9-44c81b551185,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:08.012256 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.012632 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.013004 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.013355 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.013697 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.014035 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.014375 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.014713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.015065 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.015404 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.015737 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.016066 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.016392 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Tracked resource versions report: Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: pushed versions: Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: { 'AddressGroup': {'1.2'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'ConntrackHelper': {'1.0'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Log': {'1.0'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Network': {'1.1'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Port': {'1.7'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'PortForwarding': {'1.2'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'QosPolicy': {'1.10'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroup': {'1.5'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SubPort': {'1.0'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Subnet': {'1.1'}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Trunk': {'1.1'}} Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: consumer versions: Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'ConntrackHelper': '1.0', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'LocalIPAssociation': '1.0', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Log': '1.0', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Network': '1.1', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Port': '1.7', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'PortForwarding': '1.2', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'QosPolicy': '1.10', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroup': '1.5', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroupRule': '1.2', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SubPort': '1.0', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Subnet': '1.1', Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Trunk': '1.1'}} Dec 14 03:07:08.017747 dv-cinder-818037-8-iscsi neutron-server[102573]: {{(pid=102573) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:07:08.065528 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Attempting to bind port ac09b704-afe3-4e62-adb9-44c81b551185 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:07:08.065925 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Attempting to bind port ac09b704-afe3-4e62-adb9-44c81b551185 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:07:08.066347 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Attempting to bind port ac09b704-afe3-4e62-adb9-44c81b551185 on network d6406fe1-3247-4e1c-bf97-36524d134d9d {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:07:08.071303 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 6, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:07:08.071697 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Checking segment: {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:07:08.072167 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:08.072569 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Bound using segment: {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:07:08.073071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Bound port: ac09b704-afe3-4e62-adb9-44c81b551185, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:07:08.073514 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:08.136670 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] For port ac09b704-afe3-4e62-adb9-44c81b551185, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:07:08.141179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] For port ac09b704-afe3-4e62-adb9-44c81b551185, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=ac09b704-afe3-4e62-adb9-44c81b551185,segment=NetworkSegment(f4ff8000-fd7d-41fd-9759-68872ca0eb6b),segment_id=f4ff8000-fd7d-41fd-9759-68872ca0eb6b)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:07:08.144692 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:08.206471 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e5ad13-0d63-4ec1-b3e1-76f10f87109d None None] Pushing event updated for resources: {'Port': ['ID=ac09b704-afe3-4e62-adb9-44c81b551185,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:09.677897 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46340) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:09.991112 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [None req-4c6782e6-1fae-44c5-89e3-de53b02fc400 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:07:09.992112 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-4c6782e6-1fae-44c5-89e3-de53b02fc400 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3132532 Dec 14 03:07:12.612948 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 46348) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:13.106061 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING oslo_policy.policy [None req-a81d0255-af2b-4963-8031-0a260ccac33f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:07:13.106618 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING oslo_policy.policy [None req-a81d0255-af2b-4963-8031-0a260ccac33f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:07:13.331589 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [None req-a81d0255-af2b-4963-8031-0a260ccac33f admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:07:13.332895 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a81d0255-af2b-4963-8031-0a260ccac33f admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7178493 Dec 14 03:07:16.161979 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 46368) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:16.456841 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'name': 'router1'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:16.521946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.policy [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102571) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 14 03:07:16.569822 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING oslo_policy.policy [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:07:16.570227 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING oslo_policy.policy [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 14 03:07:16.578900 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.quota [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Loaded quota_driver: . Dec 14 03:07:16.637650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:16.639612 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:16.793511 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:16.798931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:16.819947 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:16.821121 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-50bc0eb6-acb2-4afc-bd49-95a61dd1850e admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6581490 Dec 14 03:07:17.327304 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11f74171-bf18-4d67-a7ec-e3746aa4465a None None] Network d6406fe1-3247-4e1c-bf97-36524d134d9d requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:07:17.430517 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] Provisioning complete for port ac09b704-afe3-4e62-adb9-44c81b551185 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:17.430903 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:17.599576 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ac09b704-afe3-4e62-adb9-44c81b551185 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:07:17.604454 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:17.675088 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] For port ac09b704-afe3-4e62-adb9-44c81b551185, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=ac09b704-afe3-4e62-adb9-44c81b551185,segment=NetworkSegment(f4ff8000-fd7d-41fd-9759-68872ca0eb6b),segment_id=f4ff8000-fd7d-41fd-9759-68872ca0eb6b)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:07:17.680419 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:17.733753 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port ac09b704-afe3-4e62-adb9-44c81b551185 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:17.734125 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:17.753367 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f40e98d-e3cf-4474-9d8f-5df5a75465e2 None None] Pushing event updated for resources: {'Port': ['ID=ac09b704-afe3-4e62-adb9-44c81b551185,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:17.820248 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-a92870e6-fc72-4225-8b66-ee76dffb0ef7 None None] Provisioning complete for port ac09b704-afe3-4e62-adb9-44c81b551185 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:17.820620 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a92870e6-fc72-4225-8b66-ee76dffb0ef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:19.422473 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46378) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:19.556528 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ac09b704-afe3-4e62-adb9-44c81b551185 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:07:19.614590 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9cb59695-d2ef-4522-8eec-347b07fa87af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:19.617208 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port ac09b704-afe3-4e62-adb9-44c81b551185 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:19.617566 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:19.734120 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [None req-5e58fb69-d42e-48c9-a971-bab74bbae434 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:07:19.735118 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5e58fb69-d42e-48c9-a971-bab74bbae434 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3116896 Dec 14 03:07:21.818037 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2b400d7d-9c57-4de8-8aea-696568d3ada7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.311930 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46386) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:22.619943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'is_default': True, 'admin_state_up': True, 'router:external': True, 'name': 'public', 'provider:physical_network': 'physnet1'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:22.639853 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Made reservation on behalf of f5a40efb96444e869a317e4d0c361d64 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:07:22.642036 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.649882 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.721119 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.724456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.737906 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Reserving flat network on physical network physnet1 {{(pid=102572) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 14 03:07:22.757989 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a4f9f38-8524-4779-9a85-a9515ded903f,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:22.761350 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.761688 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Added segment 9f88eb15-2764-4f4a-bab3-999e2902629a of type flat for network d05a17b1-467e-47d1-82d5-54575b429fe9 Dec 14 03:07:22.806942 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.838620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.839572 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:22.840152 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:22.894416 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5814490 Dec 14 03:07:22.900997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50e867d-3185-4f3b-a9b3-8fe86aaac622 admin admin] Pushing event updated for resources: {'Network': ['ID=d05a17b1-467e-47d1-82d5-54575b429fe9,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:22.911440 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network d05a17b1-467e-47d1-82d5-54575b429fe9 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:07:23.516313 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:24.479624 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:25.480927 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46404) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:25.649122 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0a28149-3549-4a33-959e-0cfa70d2525d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:25.650423 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d0a28149-3549-4a33-959e-0cfa70d2525d admin admin] 10.222.0.43 "GET /v2.0/subnets/2a4204a1-e02e-4d1f-8360-084996a625bb HTTP/1.1" status: 200 len: 849 time: 0.1685555 Dec 14 03:07:25.746397 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:25.837249 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-2b6e3ac2-d3f4-4bb2-ada2-3fd49044cdc2 admin admin] 10.222.0.43 "GET /v2.0/routers/96ce0ef6-5efd-44a9-9a78-7337a49af0ac HTTP/1.1" status: 200 len: 704 time: 0.1801555 Dec 14 03:07:26.114692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.400859 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Allocated IP 172.20.0.1 (d6406fe1-3247-4e1c-bf97-36524d134d9d/2a4204a1-e02e-4d1f-8360-084996a625bb/8242cbf7-638a-480c-a6e6-125423959663) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:07:26.561584 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.667918 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.740921 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Network d6406fe1-3247-4e1c-bf97-36524d134d9d is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:07:26.746702 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:26.752044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:07:26.752424 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.806223 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Pushing event updated for resources: {'Port': ['ID=8242cbf7-638a-480c-a6e6-125423959663,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:26.922853 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-d481533e-2727-4ce3-b85b-84c5f1ae26ba None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:26.923465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d481533e-2727-4ce3-b85b-84c5f1ae26ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.948618 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:26.954989 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-d481533e-2727-4ce3-b85b-84c5f1ae26ba None None] Port 8242cbf7-638a-480c-a6e6-125423959663 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:07:27.157595 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:27.161840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:27.162571 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:27.241484 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Pushing event updated for resources: {'Port': ['ID=8242cbf7-638a-480c-a6e6-125423959663,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:27.283892 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Network d6406fe1-3247-4e1c-bf97-36524d134d9d is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:07:27.285175 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:27.445663 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102572) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:07:27.477661 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-e82673ff-8869-4696-939c-4eca69381f90 None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:27.478058 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e82673ff-8869-4696-939c-4eca69381f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:27.512832 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-e82673ff-8869-4696-939c-4eca69381f90 None None] Port 8242cbf7-638a-480c-a6e6-125423959663 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:07:27.536132 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:07:27.541567 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-61f8e1ad-5d44-418e-87a5-9740fb01c6f7 admin admin] 10.222.0.43 "PUT /v2.0/routers/96ce0ef6-5efd-44a9-9a78-7337a49af0ac/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.6981223 Dec 14 03:07:27.546252 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Sync routers for ids ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:07:27.559674 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Routers {'96ce0ef6-5efd-44a9-9a78-7337a49af0ac'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:07:27.560541 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:07:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:27.749898 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Set router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:07:28.173382 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:26Z', 'revision_number': 2, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port_host': None, '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:27Z', 'revision_number': 2, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:28.222690 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Checking router: 96ce0ef6-5efd-44a9-9a78-7337a49af0ac for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:07:28.223075 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Updating router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac port 8242cbf7-638a-480c-a6e6-125423959663 binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:07:28.270518 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:28.782223 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:28.790228 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:28.945633 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Pushing event updated for resources: {'Port': ['ID=8242cbf7-638a-480c-a6e6-125423959663,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:28.960816 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Attempting to bind port 8242cbf7-638a-480c-a6e6-125423959663 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:07:28.961213 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Attempting to bind port 8242cbf7-638a-480c-a6e6-125423959663 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:07:28.961638 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Attempting to bind port 8242cbf7-638a-480c-a6e6-125423959663 on network d6406fe1-3247-4e1c-bf97-36524d134d9d {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:07:28.964458 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.964820 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.965175 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.965512 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.965840 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.966166 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.966490 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.966811 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.967156 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.967494 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.967817 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.968133 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.968446 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Tracked resource versions report: Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: pushed versions: Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: { 'AddressGroup': {'1.2'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'ConntrackHelper': {'1.0'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Log': {'1.0'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Network': {'1.1'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Port': {'1.7'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'PortForwarding': {'1.2'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'QosPolicy': {'1.10'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroup': {'1.5'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SubPort': {'1.0'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Subnet': {'1.1'}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Trunk': {'1.1'}} Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: consumer versions: Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'ConntrackHelper': '1.0', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'LocalIPAssociation': '1.0', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Log': '1.0', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Network': '1.1', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Port': '1.7', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'PortForwarding': '1.2', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'QosPolicy': '1.10', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroup': '1.5', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroupRule': '1.2', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SubPort': '1.0', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Subnet': '1.1', Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Trunk': '1.1'}} Dec 14 03:07:28.969774 dv-cinder-818037-8-iscsi neutron-server[102574]: {{(pid=102574) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:07:28.976907 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:07:28.977315 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Checking segment: {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:07:28.977789 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:28.978167 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Bound using segment: {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:07:28.979748 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Bound port: 8242cbf7-638a-480c-a6e6-125423959663, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4ff8000-fd7d-41fd-9759-68872ca0eb6b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 265, 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:07:28.979748 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.039675 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-759c0359-347c-41ce-b76d-c0d7e0ef0010 None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:29.040326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-759c0359-347c-41ce-b76d-c0d7e0ef0010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.046791 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] For port 8242cbf7-638a-480c-a6e6-125423959663, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:07:29.067692 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] For port 8242cbf7-638a-480c-a6e6-125423959663, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=8242cbf7-638a-480c-a6e6-125423959663,segment=NetworkSegment(f4ff8000-fd7d-41fd-9759-68872ca0eb6b),segment_id=f4ff8000-fd7d-41fd-9759-68872ca0eb6b)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:07:29.073406 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.074842 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-759c0359-347c-41ce-b76d-c0d7e0ef0010 None None] Port 8242cbf7-638a-480c-a6e6-125423959663 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:07:29.128743 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5aa29eb-899e-4b73-a655-c0f8e105f08a None None] Pushing event updated for resources: {'Port': ['ID=8242cbf7-638a-480c-a6e6-125423959663,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:29.152186 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Routers {'96ce0ef6-5efd-44a9-9a78-7337a49af0ac'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:07:29.153132 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:07:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:29.248719 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] Set router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:07:29.301217 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:29.301589 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.382553 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.413902 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] For port 8242cbf7-638a-480c-a6e6-125423959663, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=8242cbf7-638a-480c-a6e6-125423959663,segment=NetworkSegment(f4ff8000-fd7d-41fd-9759-68872ca0eb6b),segment_id=f4ff8000-fd7d-41fd-9759-68872ca0eb6b)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:07:29.418499 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:29.459214 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:26Z', 'revision_number': 2, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port_host': None, '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:29Z', 'revision_number': 4, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:29.464633 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec36ef41-d9d0-41bd-846e-8dc49e52329c None None] Pushing event updated for resources: {'Port': ['ID=8242cbf7-638a-480c-a6e6-125423959663,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:29.486136 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239c911d-865f-4ad7-b1ab-55340ea2db93 None None] The sync data for ids ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'] in dv-cinder-818037-8-iscsi is: [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:26Z', 'revision_number': 2, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port_host': None, '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:29Z', 'revision_number': 4, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:07:29.972856 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46426) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:30.080456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfa3dccd-5bb8-4522-8ae3-648f134ea5d9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:30.081819 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-bfa3dccd-5bb8-4522-8ae3-648f134ea5d9 admin admin] 10.222.0.43 "GET /v2.0/networks/d05a17b1-467e-47d1-82d5-54575b429fe9 HTTP/1.1" status: 200 len: 842 time: 0.1080043 Dec 14 03:07:30.091831 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'name': 'public-subnet', 'gateway_ip': '172.27.3.1', 'cidr': '172.27.3.0/24', 'ip_version': 4, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:30.112655 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Made reservation on behalf of f5a40efb96444e869a317e4d0c361d64 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:07:30.114885 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:30.394214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.objects.ports [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102572) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 14 03:07:30.394643 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:30.445219 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4cd56c41-a067-4663-888d-62ea7a6d5a3d,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:30.455413 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:07:30.455764 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Network hostable DHCP agents. Network: d05a17b1-467e-47d1-82d5-54575b429fe9, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:07:30.471800 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:07:30.480889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, d05a17b1-467e-47d1-82d5-54575b429fe9) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:30.485187 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:30.485783 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:30.493402 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-371b48d9-1490-4812-9fd6-e6e6afea1de3 None None] Network d05a17b1-467e-47d1-82d5-54575b429fe9 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:07:30.501822 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-41ea62a7-ea99-4f4d-805d-ce610adb1e74 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4134495 Dec 14 03:07:30.599857 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8150b45e-b30d-4c81-a3d7-840d5cfbe7de None None] Network d05a17b1-467e-47d1-82d5-54575b429fe9 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:07:33.004758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46434) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:33.198937 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8fc5f3bd-5c0e-4185-b8b3-0f711fe8f1b4 admin admin] 10.222.0.43 "GET /v2.0/routers/96ce0ef6-5efd-44a9-9a78-7337a49af0ac HTTP/1.1" status: 200 len: 710 time: 0.1929417 Dec 14 03:07:33.290275 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fadca52e-2823-49bc-9f8d-d17ec369f1ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:07:33.291752 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-fadca52e-2823-49bc-9f8d-d17ec369f1ad admin admin] 10.222.0.43 "GET /v2.0/networks/d05a17b1-467e-47d1-82d5-54575b429fe9 HTTP/1.1" status: 200 len: 886 time: 0.0868688 Dec 14 03:07:33.301439 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:07:33.544198 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:33.785626 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:33.861550 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:33.974484 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Allocated IP 172.27.3.227 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/3b3fa7e9-320f-4770-8ebc-3ff433f4dadb) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:07:34.084389 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.117714 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.134255 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:07:34.150440 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:07:34.164314 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:07:34.225434 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Pushing event updated for resources: {'Port': ['ID=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:34.406266 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.694680 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3676644', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3729749', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7192'] for router, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.698143 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3676655', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3676662', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3729756'] for router, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.804932 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:07:34.908421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:07:34.912794 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:34.913902 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e2131203-62c5-4a6b-bc0f-2417e0cf2bf6 admin admin] 10.222.0.43 "PUT /v2.0/routers/96ce0ef6-5efd-44a9-9a78-7337a49af0ac HTTP/1.1" status: 200 len: 890 time: 1.6159022 Dec 14 03:07:35.575492 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 8242cbf7-638a-480c-a6e6-125423959663 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:07:35.622751 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:35.623163 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:35.971411 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:07:36.484078 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Sync routers for ids ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:07:36.495693 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Routers {'96ce0ef6-5efd-44a9-9a78-7337a49af0ac'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:07:36.496367 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:07:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:36.700318 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Set router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:07:37.161822 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:34Z', 'revision_number': 4, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port': {'id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:c2:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:33Z', 'updated_at': '2021-12-14T03:07:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:29Z', 'revision_number': 5, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:37.216806 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Checking router: 96ce0ef6-5efd-44a9-9a78-7337a49af0ac for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:07:37.217154 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Updating router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:07:37.263126 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.554127 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46446) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:07:37.576375 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.582029 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.636439 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Attempting to bind port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:07:37.636821 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Attempting to bind port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:07:37.637193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Attempting to bind port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:07:37.639962 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f413cafe-d85f-4658-9af2-f72fb744be36 None None] Pushing event updated for resources: {'Port': ['ID=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:37.644819 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:07:37.645198 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:07:37.645611 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.645998 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:07:37.646475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Bound port: 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:07:37.646875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.673083 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3494aa6a-b34e-4930-bfc2-79cf6ec9896c admin admin] 10.222.0.43 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1126730 Dec 14 03:07:37.700005 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] For port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:07:37.703437 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] For port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:07:37.708485 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:37.768007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f413cafe-d85f-4658-9af2-f72fb744be36 None None] Pushing event updated for resources: {'Port': ['ID=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:37.772654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Routers {'96ce0ef6-5efd-44a9-9a78-7337a49af0ac'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:07:37.773274 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:07:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:37.891889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] Set router 96ce0ef6-5efd-44a9-9a78-7337a49af0ac gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:07:38.102776 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:34Z', 'revision_number': 4, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port': {'id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:c2:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:33Z', 'updated_at': '2021-12-14T03:07:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:29Z', 'revision_number': 5, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:07:38.129625 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b59ad924-65db-468c-983f-e88fe0c4f183 None None] The sync data for ids ['96ce0ef6-5efd-44a9-9a78-7337a49af0ac'] in dv-cinder-818037-8-iscsi is: [{'id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'name': 'router1', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227'}], 'enable_snat': True}, 'gw_port_id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:07:16Z', 'updated_at': '2021-12-14T03:07:34Z', 'revision_number': 4, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'gw_port': {'id': '3b3fa7e9-320f-4770-8ebc-3ff433f4dadb', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:c2:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:33Z', 'updated_at': '2021-12-14T03:07:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '8242cbf7-638a-480c-a6e6-125423959663', 'name': '', 'network_id': 'd6406fe1-3247-4e1c-bf97-36524d134d9d', 'tenant_id': 'd7f09e72d52d44edad5f503d25ed1815', 'mac_address': 'fa:16:3e:a0:32:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96ce0ef6-5efd-44a9-9a78-7337a49af0ac', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:07:26Z', 'updated_at': '2021-12-14T03:07:29Z', 'revision_number': 5, 'project_id': 'd7f09e72d52d44edad5f503d25ed1815', 'subnets': [{'id': '2a4204a1-e02e-4d1f-8360-084996a625bb', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '126dec19-adb4-4f78-986f-077b226d9b25'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:07:39.590570 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:07:39.650303 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:39.650686 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:39.742906 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:39.765273 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:07:39.770283 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:39.822936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=3b3fa7e9-320f-4770-8ebc-3ff433f4dadb,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:07:41.597646 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:07:41.679056 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 3b3fa7e9-320f-4770-8ebc-3ff433f4dadb triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:07:41.679765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:49.606625 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-797af817-3059-4e24-88aa-05b5156ae58c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:51.821148 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-66d90806-55d4-4636-888e-1241e018946b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:53.521203 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:54.489736 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:07:55.754644 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:12.973575 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:08:19.610987 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-925467d8-c9aa-4475-98de-b1b97947cdcc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:21.830062 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1aa2bad4-5c0c-491a-854b-2170f369f20f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:23.518728 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:24.482392 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:25.749932 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:49.614580 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d208a717-3b59-4d9e-a571-2b7893a218db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:49.972368 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:08:51.823742 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-cff7bf9d-33a4-4b6d-ba7e-2242870a0680 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:53.520939 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:54.483831 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:55.744614 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:08:58.636394 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46932) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:08:58.697175 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.pecan_wsgi.hooks.translation [None req-08e6e03f-a9f7-4392-a4fd-9bbf4ad84da3 admin admin] GET failed (client error): The resource could not be found. Dec 14 03:08:58.698461 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-08e6e03f-a9f7-4392-a4fd-9bbf4ad84da3 admin admin] 10.222.0.43 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0611153 Dec 14 03:08:58.858522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77f26c29-4d75-4c78-8d73-a7c8751973a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:08:58.859937 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-77f26c29-4d75-4c78-8d73-a7c8751973a0 admin admin] 10.222.0.43 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1568968 Dec 14 03:09:01.223082 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46942) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:01.312197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d79d56e-6fb7-4c1a-98cc-dc002b1fbd6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:01.313532 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0d79d56e-6fb7-4c1a-98cc-dc002b1fbd6c admin admin] 10.222.0.43 "GET /v2.0/subnets/2a4204a1-e02e-4d1f-8360-084996a625bb HTTP/1.1" status: 200 len: 849 time: 0.0895050 Dec 14 03:09:01.323382 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:09:01.406885 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:01.540979 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8763912258780'] for subnet, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:01.575131 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:01.575720 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:01.576972 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] 10.222.0.43 "PUT /v2.0/subnets/2a4204a1-e02e-4d1f-8360-084996a625bb HTTP/1.1" status: 200 len: 868 time: 0.2571580 Dec 14 03:09:01.580135 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0af4f73-d9a8-4efd-9e1d-0ac2201b4580 None None] Network d6406fe1-3247-4e1c-bf97-36524d134d9d requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:09:01.596322 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a4204a1-e02e-4d1f-8360-084996a625bb,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:01.604311 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.604704 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.605034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.605375 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.605705 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.606034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.606383 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.606713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.607072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.607422 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.607748 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.608069 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.608540 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8689b18d-33e1-4dbc-90cf-4dcc8819f1d7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:01.861765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-0da007a6-0d58-4625-88ba-0bfa1adf5091 None None] Provisioning complete for port ac09b704-afe3-4e62-adb9-44c81b551185 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:09:01.862391 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0da007a6-0d58-4625-88ba-0bfa1adf5091 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:01.946378 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-0da007a6-0d58-4625-88ba-0bfa1adf5091 None None] Provisioning complete for port 8242cbf7-638a-480c-a6e6-125423959663 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:09:01.946667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0da007a6-0d58-4625-88ba-0bfa1adf5091 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:03.964657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46950) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:04.156875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfdcb2cd-d577-46b1-b391-53381f328669 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:04.157260 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfdcb2cd-d577-46b1-b391-53381f328669 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:04.158759 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-bfdcb2cd-d577-46b1-b391-53381f328669 admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1931541 Dec 14 03:09:06.501841 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46958) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:06.632001 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a39796c3-2b51-40c1-8566-6230665b42dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:06.633039 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a39796c3-2b51-40c1-8566-6230665b42dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:06.634516 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a39796c3-2b51-40c1-8566-6230665b42dd admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1317456 Dec 14 03:09:08.998714 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46966) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:09.118349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd0db9b8-4414-45fd-99ed-1e401e4e129d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:09.119675 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-fd0db9b8-4414-45fd-99ed-1e401e4e129d admin admin] 10.222.0.43 "GET /v2.0/networks/d05a17b1-467e-47d1-82d5-54575b429fe9 HTTP/1.1" status: 200 len: 886 time: 0.1200016 Dec 14 03:09:11.563805 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46974) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:11.691332 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f75803f-843a-45c2-9a9e-3b68a7c3a443 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:11.692669 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9f75803f-843a-45c2-9a9e-3b68a7c3a443 admin admin] 10.222.0.43 "GET /v2.0/networks/d6406fe1-3247-4e1c-bf97-36524d134d9d HTTP/1.1" status: 200 len: 869 time: 0.1278989 Dec 14 03:09:14.053681 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46982) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:14.186751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9a7aa1d-6c03-4b2c-9ee8-fb05a57e89ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:14.187490 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9a7aa1d-6c03-4b2c-9ee8-fb05a57e89ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:14.189688 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f9a7aa1d-6c03-4b2c-9ee8-fb05a57e89ae admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1343811 Dec 14 03:09:16.547441 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46990) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:16.734615 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f92df2b-9672-4041-848b-9093c814bd4a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:16.734977 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f92df2b-9672-4041-848b-9093c814bd4a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:16.736489 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-2f92df2b-9672-4041-848b-9093c814bd4a admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1881039 Dec 14 03:09:19.098657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 46998) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:19.188726 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46501ac4-1a32-4ab4-9b2f-184bec3203fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:19.190027 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-46501ac4-1a32-4ab4-9b2f-184bec3203fa admin admin] 10.222.0.43 "GET /v2.0/subnets/2a4204a1-e02e-4d1f-8360-084996a625bb HTTP/1.1" status: 200 len: 868 time: 0.0903680 Dec 14 03:09:19.617679 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5277fe40-b172-4dec-908c-508fbd823d70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:21.544070 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47006) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:21.630971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88c08da5-c2f8-409c-9509-dc4d95e428e9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:21.632888 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-88c08da5-c2f8-409c-9509-dc4d95e428e9 admin admin] 10.222.0.43 "GET /v2.0/subnets/4cd56c41-a067-4663-888d-62ea7a6d5a3d HTTP/1.1" status: 200 len: 816 time: 0.0878727 Dec 14 03:09:21.826804 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-50d93ef1-d8a2-48fc-9ead-9918dc9bf3cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:23.524193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:24.487456 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:25.746193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:26.970770 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:09:46.641093 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47062) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:46.688298 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [None req-5d27d217-8908-4488-9192-31d6e5297cac admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:09:46.689301 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5d27d217-8908-4488-9192-31d6e5297cac admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0472636 Dec 14 03:09:49.169782 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47070) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:49.227920 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.pecan_wsgi.hooks.translation [None req-d206d37b-adf1-4801-a4e9-bb3afeaa6c0b admin admin] GET failed (client error): The resource could not be found. Dec 14 03:09:49.229154 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d206d37b-adf1-4801-a4e9-bb3afeaa6c0b admin admin] 10.222.0.43 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0584371 Dec 14 03:09:49.310208 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c021441b-f6f7-4277-ba8b-e1a398b198a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:49.311658 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c021441b-f6f7-4277-ba8b-e1a398b198a0 admin admin] 10.222.0.43 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0779555 Dec 14 03:09:49.619693 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-43595c01-d364-49e0-ab86-511e05ee9314 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.695603 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47078) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:51.747161 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:09:51.770235 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Made reservation on behalf of f5a40efb96444e869a317e4d0c361d64 for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:09:51.773081 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.825391 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING neutron.services.revisions.revision_plugin [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Could not find related network for resource to bump revision. Dec 14 03:09:51.829165 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-939c1346-9e36-4dd8-823f-d2360c9c29e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.842019 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 279} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:09:51.855536 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8763912245625', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.856082 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Unsubscribe: segment precommit_create {{(pid=102571) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 14 03:09:51.856590 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Added segment 6f501cbc-4819-42fe-9d00-1025465763ca of type vlan for network 03fb523b-5e4c-4381-93e1-fe00226b5d88 Dec 14 03:09:51.937682 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.970659 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.971932 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:51.972652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:51.993769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2970350 Dec 14 03:09:52.073893 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Pushing event updated for resources: {'Network': ['ID=03fb523b-5e4c-4381-93e1-fe00226b5d88,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:52.083723 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.084109 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.084451 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.084794 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.085124 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.085451 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.085928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.086118 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.086542 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.086803 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.087173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.087504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.087786 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef2f5edb-c853-4f5c-b9c3-4e4105d444a9 admin admin] Tracked resource versions report: Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: pushed versions: Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: { 'AddressGroup': {'1.2'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'ConntrackHelper': {'1.0'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Log': {'1.0'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Network': {'1.1'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Port': {'1.7'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'PortForwarding': {'1.2'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'QosPolicy': {'1.10'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroup': {'1.5'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SubPort': {'1.0'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Subnet': {'1.1'}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Trunk': {'1.1'}} Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: consumer versions: Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'ConntrackHelper': '1.0', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'LocalIPAssociation': '1.0', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Log': '1.0', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Network': '1.1', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Port': '1.7', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'PortForwarding': '1.2', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'QosPolicy': '1.10', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroup': '1.5', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroupRule': '1.2', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SubPort': '1.0', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Subnet': '1.1', Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Trunk': '1.1'}} Dec 14 03:09:52.089162 dv-cinder-818037-8-iscsi neutron-server[102571]: {{(pid=102571) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:09:52.130563 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:09:53.527279 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:54.405922 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47092) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:09:54.465439 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.pecan_wsgi.hooks.translation [None req-21dd7d36-de0b-458d-a671-b75175611389 admin admin] GET failed (client error): The resource could not be found. Dec 14 03:09:54.466678 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-21dd7d36-de0b-458d-a671-b75175611389 admin admin] 10.222.0.43 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0598183 Dec 14 03:09:54.489590 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:54.538949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22cca36d-fb48-47d9-8b53-82c115025b8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:54.540413 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-22cca36d-fb48-47d9-8b53-82c115025b8d admin admin] 10.222.0.43 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0692804 Dec 14 03:09:54.552986 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'ip_version': 4, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:09:54.580880 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Made reservation on behalf of f5a40efb96444e869a317e4d0c361d64 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:09:54.583379 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:54.743416 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:54.801071 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Pushing event updated for resources: {'Subnet': ['ID=95c7ceea-6f7b-42ef-aca5-1013b5ca048c,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:54.803779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Checking segment: {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:09:54.804135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Network hostable DHCP agents. Network: 03fb523b-5e4c-4381-93e1-fe00226b5d88, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:09:54.820949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:09:54.829049 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 03fb523b-5e4c-4381-93e1-fe00226b5d88) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:09:54.834443 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:09:54.835698 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:54.837267 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28d70f69-ca15-4948-a500-e17e77178c55 None None] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:09:54.858626 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3a5bb772-5ca5-47d8-8786-28dfa292a70e admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3049757 Dec 14 03:09:54.941055 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-03fb523b-5e4c-4381-93e1-fe00226b5d88', 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88', 'project_id': 'f5a40efb96444e869a317e4d0c361d64', 'fixed_ips': [{'subnet_id': '95c7ceea-6f7b-42ef-aca5-1013b5ca048c'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:09:54.941964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.085016 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Allocated IP 192.168.233.2 (03fb523b-5e4c-4381-93e1-fe00226b5d88/95c7ceea-6f7b-42ef-aca5-1013b5ca048c/4647d071-5d88-4481-a471-36733475bcc6) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:09:55.321839 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.327875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.372294 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:09:55.375823 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Pushing event updated for resources: {'Port': ['ID=4647d071-5d88-4481-a471-36733475bcc6,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:55.378920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:09:55.383724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:09:55.386388 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.386752 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.387139 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.387478 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.387803 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.388129 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.388455 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.388777 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.389102 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.389441 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.389768 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.390071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.390384 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:09:55.444723 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Attempting to bind port 4647d071-5d88-4481-a471-36733475bcc6 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:09:55.445096 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Attempting to bind port 4647d071-5d88-4481-a471-36733475bcc6 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:09:55.445445 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Attempting to bind port 4647d071-5d88-4481-a471-36733475bcc6 on network 03fb523b-5e4c-4381-93e1-fe00226b5d88 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:09:55.450364 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:09:55.450733 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Checking segment: {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:09:55.451156 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.451549 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Bound using segment: {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:09:55.452011 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Bound port: 4647d071-5d88-4481-a471-36733475bcc6, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:09:55.452386 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.515459 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] For port 4647d071-5d88-4481-a471-36733475bcc6, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:09:55.518456 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] For port 4647d071-5d88-4481-a471-36733475bcc6, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=4647d071-5d88-4481-a471-36733475bcc6,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:09:55.523629 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:55.580330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef124a8-ff36-492a-8b5e-c4efa4aacb52 None None] Pushing event updated for resources: {'Port': ['ID=4647d071-5d88-4481-a471-36733475bcc6,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:55.748440 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:56.390887 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21e0c538-469f-4ce7-8c10-a6879403eca5 None None] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:09:56.460203 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] Provisioning complete for port 4647d071-5d88-4481-a471-36733475bcc6 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:09:56.460576 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:56.575797 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:56.617431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] For port 4647d071-5d88-4481-a471-36733475bcc6, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=4647d071-5d88-4481-a471-36733475bcc6,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:09:56.621995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:56.678129 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f2aef05-614d-4650-91ee-d52dc682e19d None None] Pushing event updated for resources: {'Port': ['ID=4647d071-5d88-4481-a471-36733475bcc6,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:09:56.844805 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-8d7dec6f-a8b6-4a43-a5b9-faeb7c044908 None None] Provisioning complete for port 4647d071-5d88-4481-a471-36733475bcc6 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:09:56.845344 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8d7dec6f-a8b6-4a43-a5b9-faeb7c044908 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:09:57.671645 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 4647d071-5d88-4481-a471-36733475bcc6 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:09:57.720867 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 4647d071-5d88-4481-a471-36733475bcc6 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:09:57.721244 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:03.969136 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:10:19.622174 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-dc9071ae-eb59-44cc-9fdc-ee96d4b37016 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:21.834912 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9b4f0afb-a503-4385-966a-d9906960dc20 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:23.529918 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:24.494298 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:25.750585 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:40.967520 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:10:49.624891 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-778b18af-65d4-4976-862b-d5b8855028ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:51.836133 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b1adcc45-a394-4ff8-a953-d4d19621d2ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:53.533360 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:54.497475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:10:55.754585 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:06.609089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47136) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:11:06.615515 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [None req-492aa51a-3420-4dd3-88f4-4b6477fea8ab tempest-verify_tempest_config-1247779946 tempest-verify_tempest_config-1247779946-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:11:06.616462 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-492aa51a-3420-4dd3-88f4-4b6477fea8ab tempest-verify_tempest_config-1247779946 tempest-verify_tempest_config-1247779946-project] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0063875 Dec 14 03:11:06.901488 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47154) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:11:07.002140 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.075175 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.078549 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.125927 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1e15ca78bdf74384920d15239a125285&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2234209 Dec 14 03:11:07.126880 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1b4536d-354b-408d-a9b9-bc4413403d8e,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:11:07.128616 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47158) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:11:07.133565 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.133920 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.134262 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.134597 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.134932 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.135288 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.135614 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.135939 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.136263 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.136587 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.136908 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.137225 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.137541 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf39d1c-de90-4daf-8748-7c6b9c7e4461 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.201528 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.221136 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.310692 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.313256 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:07.314400 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c1b4536d-354b-408d-a9b9-bc4413403d8e HTTP/1.1" status: 204 len: 168 time: 0.1848400 Dec 14 03:11:07.322415 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1b4536d-354b-408d-a9b9-bc4413403d8e,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:11:07.328943 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.329240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.329586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.329935 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.330268 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.330601 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.330946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.331305 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.332175 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.332504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.332833 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.333158 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:07.333481 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14d45847-fb9a-43ed-94a9-05100b370cd4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:11:17.966108 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:11:19.627179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-92f01b12-faf8-4872-a328-89a8d26cae15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:21.839372 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f3840b49-6027-453f-be56-f4e27d5b27f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:23.535271 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:24.499722 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:25.756984 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:49.629179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1fc808a6-122e-4051-b789-0f9dca3ae8a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:51.840394 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-4c381ee2-5591-4029-a72d-11be755dc64c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:53.540741 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:54.502775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:11:54.964273 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:11:55.760003 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:19.631234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d90890a1-f902-4661-bf69-1fbf1f88de96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:21.842071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-98059679-616e-43c8-95c2-0641592b897f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:23.540762 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:24.505512 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:25.762415 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:31.963220 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 5 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:12:41.177279 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3727862'] for agent, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:49.632037 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-27733f5f-8c0a-4b5d-878c-c6304d338575 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:51.842654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e13251e6-b7d7-491c-9855-e3343a6e9736 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:53.544021 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:54.511343 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:55.763428 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47232) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:12:55.771645 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:12:55.868012 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-e184cf78-5d51-412b-974e-ba68a45ed1b0 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1031749 Dec 14 03:12:58.260275 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47242) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:12:58.320169 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-aa1c4006-ab46-4c07-97cf-9f5fd89acc73 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0587766 Dec 14 03:13:08.961843 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:13:11.136355 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:19.633498 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6abd8a4d-09d0-4837-90c9-4c0d0c28a43b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:21.846332 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-71b2a306-30e9-4a16-9aa8-5f7fa9ce74da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:23.546734 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:24.511454 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:25.764470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:41.160165 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:45.960849 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:13:49.636157 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ea77b14f-0bc1-498a-854b-a472936c00bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:51.848273 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-882c281e-f154-4c59-879c-41a5007673ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:53.551018 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:54.516225 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:13:55.770064 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:11.159464 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:19.637585 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6eb7126b-f1c1-4110-b7ba-61547c8f1a7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:21.853330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2842c437-28db-453e-a3e2-96ea02e15c04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:22.960161 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:14:23.552430 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:24.519889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:25.775027 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.504063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47478) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:30.515804 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47484) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:30.532114 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47490) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:30.544808 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47494) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:30.730215 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-network', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:30.753576 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Made reservation on behalf of da53d564588b46b7bd658659f40a6ded for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:30.757982 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.769354 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.779323 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-531967009-network', 'tenant_id': '7efcbf12d6654bc68690363892415b77'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:30.808126 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-638528978-network', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:30.828953 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Made reservation on behalf of 7efcbf12d6654bc68690363892415b77 for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:30.831654 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.847102 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.856457 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Made reservation on behalf of bb4be946dd9b4b2080fb3b398521624e for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:30.859150 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.871728 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.878763 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-916264010-network', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:30.904621 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.919209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 267} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:14:30.932525 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.933307 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Added segment 1270198f-e0f2-4558-aaef-824767bb1c50 of type vlan for network 61e8c126-6b7d-4549-9293-90629e6175d3 Dec 14 03:14:30.948853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.950649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.972165 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.979555 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Made reservation on behalf of 11634c00674445cb81d9dabfbcc791a8 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:30.981826 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.994345 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:30.998539 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.060796 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88b11454-71c9-4384-aaac-cd4acf585726,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.075188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.076214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:31.076848 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.090089 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.134739 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=344c1b72-e136-4965-9073-719e9454c82f,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.144419 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Pushing event updated for resources: {'Network': ['ID=61e8c126-6b7d-4549-9293-90629e6175d3,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.152219 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.152571 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.152914 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.153251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.153583 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.153911 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.154258 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.154592 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.154930 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.155300 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.156318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.156318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.156318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Tracked resource versions report: Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: pushed versions: Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: { 'AddressGroup': {'1.2'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'ConntrackHelper': {'1.0'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Log': {'1.0'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Network': {'1.1'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Port': {'1.7'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'PortForwarding': {'1.2'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'QosPolicy': {'1.10'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroup': {'1.5'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SubPort': {'1.0'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Subnet': {'1.1'}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Trunk': {'1.1'}} Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: consumer versions: Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: HyperV agent@hv-cinder-81803: {}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'ConntrackHelper': '1.0', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'LocalIPAssociation': '1.0', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Log': '1.0', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Network': '1.1', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Port': '1.7', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'PortForwarding': '1.2', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'QosPolicy': '1.10', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroup': '1.5', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SecurityGroupRule': '1.2', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'SubPort': '1.0', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Subnet': '1.1', Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: 'Trunk': '1.1'}} Dec 14 03:14:31.157381 dv-cinder-818037-8-iscsi neutron-server[102572]: {{(pid=102572) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:14:31.160483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 257} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:14:31.166795 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.167515 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.167610 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.168296 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.168641 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.169103 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.169381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.169813 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.170285 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.170715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.171181 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.171502 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.171746 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.182108 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.182569 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.183277 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.183277 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.183500 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.183827 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.184174 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.184509 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.184838 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.192453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.192928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.193490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.196020 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:31.197188 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e77c164d-6f85-4c71-b1f9-6e8356f685da admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.6920428 Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Tracked resource versions report: Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: pushed versions: Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: { 'AddressGroup': {'1.2'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'ConntrackHelper': {'1.0'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Log': {'1.0'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Network': {'1.1'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Port': {'1.7'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'PortForwarding': {'1.2'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'QosPolicy': {'1.10'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroup': {'1.5'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SubPort': {'1.0'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Subnet': {'1.1'}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Trunk': {'1.1'}} Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: consumer versions: Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: HyperV agent@hv-cinder-81803: {}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'ConntrackHelper': '1.0', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'LocalIPAssociation': '1.0', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Log': '1.0', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Network': '1.1', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Port': '1.7', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'PortForwarding': '1.2', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'QosPolicy': '1.10', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroup': '1.5', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SecurityGroupRule': '1.2', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'SubPort': '1.0', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Subnet': '1.1', Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: 'Trunk': '1.1'}} Dec 14 03:14:31.199650 dv-cinder-818037-8-iscsi neutron-server[102571]: {{(pid=102571) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:14:31.201646 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 61e8c126-6b7d-4549-9293-90629e6175d3 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:14:31.208608 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.216026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47522) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:31.223108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Request body: {'subnet': {'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-subnet', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:31.251156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 277} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:14:31.272887 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.273235 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Added segment 63d17698-aa5e-4fb8-873f-d90c459e1bf5 of type vlan for network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 Dec 14 03:14:31.344638 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.346041 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Made reservation on behalf of da53d564588b46b7bd658659f40a6ded for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:31.358988 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.365202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.383395 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 263} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:14:31.399182 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.399409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.399730 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Added segment a99fd986-ad0c-461f-859e-1ffa364c753d of type vlan for network 7e397d2e-d5ba-40c3-8051-57991a288ab3 Dec 14 03:14:31.405334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.406231 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Added segment 45d9b456-a3f1-4779-951e-75d07e818a26 of type vlan for network adc7b7f7-be75-4e68-a215-6654c2c27cac Dec 14 03:14:31.495932 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb68a42c-409d-4c95-8e71-55975dff464d,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.516469 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.539799 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.541327 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:31.542263 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.632679 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aea87a0e-e3e5-4701-a478-4c60cdb9ea1c,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.640717 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.642327 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:31.643314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.657081 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.1396077 Dec 14 03:14:31.662953 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47530) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:31.671075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Request body: {'subnet': {'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-subnet', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:31.675663 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.696853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a71e12-7bad-4701-9e9f-bb38d4d15419 admin admin] Pushing event updated for resources: {'Network': ['ID=b4af40aa-6be1-48c2-866d-05aa1bdec9d3,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.712185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:14:31.766162 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Made reservation on behalf of bb4be946dd9b4b2080fb3b398521624e for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:31.769238 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.769632 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] Pushing event updated for resources: {'Network': ['ID=adc7b7f7-be75-4e68-a215-6654c2c27cac,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:31.779972 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-9d755b05-2ecc-4c33-9264-886f9218b031 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.2468698 Dec 14 03:14:31.785150 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47536) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:31.797148 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.798381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:31.799207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:31.814477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Request body: {'subnet': {'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-531967009-subnet', 'tenant_id': '7efcbf12d6654bc68690363892415b77', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:31.843903 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network adc7b7f7-be75-4e68-a215-6654c2c27cac details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:14:31.899407 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Made reservation on behalf of 7efcbf12d6654bc68690363892415b77 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:31.902360 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.058940 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47550) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:32.060718 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.5127509 Dec 14 03:14:32.072225 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Request body: {'subnet': {'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-916264010-subnet', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:32.085351 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7736d76b-5630-4a25-b5e8-87de66c80973 admin admin] Pushing event updated for resources: {'Network': ['ID=7e397d2e-d5ba-40c3-8051-57991a288ab3,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:32.101126 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:14:32.132090 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Made reservation on behalf of 11634c00674445cb81d9dabfbcc791a8 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:32.143977 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.178513 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.355651 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8711f032-5b57-4823-aa19-b0e6030552b6,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:32.384057 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Checking segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:32.384549 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Network hostable DHCP agents. Network: 61e8c126-6b7d-4549-9293-90629e6175d3, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:14:32.396820 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.471518 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:14:32.493227 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Pushing event updated for resources: {'Subnet': ['ID=2088257b-adb7-490f-afb9-fe03d7b4ad30,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:32.502170 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.504471 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 61e8c126-6b7d-4549-9293-90629e6175d3) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:32.511346 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:32.512011 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.515456 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b4c84e8-5a29-4954-a701-39ae215f10ff None None] Network 61e8c126-6b7d-4549-9293-90629e6175d3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:32.534564 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Checking segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:32.535322 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Network hostable DHCP agents. Network: b4af40aa-6be1-48c2-866d-05aa1bdec9d3, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:14:32.548552 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-93267326-fa3e-488b-8b0f-8e4e26326b53 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.3302467 Dec 14 03:14:32.554145 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47564) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:32.560643 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:32.592927 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:14:32.601009 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, b4af40aa-6be1-48c2-866d-05aa1bdec9d3) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:32.618920 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:32.620000 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.623778 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.625542 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.632013 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-395c1c13-475c-4a79-9acb-d940762a10a0 None None] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:32.671889 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Pushing event updated for resources: {'Subnet': ['ID=54fa88c0-5b07-4018-9346-f1d3f6f3df1d,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:32.698073 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47566) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:32.707356 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-b0c761f1-a9c1-480f-8260-f5d9cf27678e admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.0408123 Dec 14 03:14:32.717659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47570) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:32.720222 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Checking segment: {'id': '45d9b456-a3f1-4779-951e-75d07e818a26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:32.720605 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Network hostable DHCP agents. Network: adc7b7f7-be75-4e68-a215-6654c2c27cac, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:14:32.750363 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:32.758334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.778748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Network adc7b7f7-be75-4e68-a215-6654c2c27cac is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:14:32.836195 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.864134 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Checking segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:32.864700 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Network hostable DHCP agents. Network: 7e397d2e-d5ba-40c3-8051-57991a288ab3, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:14:32.892475 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, adc7b7f7-be75-4e68-a215-6654c2c27cac) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:32.907315 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-61e8c126-6b7d-4549-9293-90629e6175d3', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:14:32.915688 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.920056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:14:32.926665 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:32.927292 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.934459 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc81a563-179d-4cba-977d-84ceacabb0ec,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:32.938838 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 7e397d2e-d5ba-40c3-8051-57991a288ab3) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:32.946061 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efd26586-3a15-4397-8dba-ad75d1b73841 None None] Network adc7b7f7-be75-4e68-a215-6654c2c27cac requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:32.966713 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:32.967515 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:32.975589 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a62aca0a-c858-4f07-93df-13b0fce001cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.003822 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-87c3ff03-5ebc-45c5-bfc8-18d43d3f6607 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.9430773 Dec 14 03:14:33.004742 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47588) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:33.010050 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:33.029297 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-238ce749-70c9-4278-8240-9df49f880678 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2421720 Dec 14 03:14:33.047952 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93dec0f6-d999-4369-b442-79480a682f3e None None] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:33.076531 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.077988 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.141847 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.142873 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.164541 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.174430 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f3436ea-057f-48b0-b374-0a8339401d29 None None] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:33.197738 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.360443 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.378519 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9a94fd8-26d9-4813-b123-994bc1a966ca None None] Network adc7b7f7-be75-4e68-a215-6654c2c27cac requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:33.507467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.553637 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Allocated IP 172.20.0.2 (61e8c126-6b7d-4549-9293-90629e6175d3/8711f032-5b57-4823-aa19-b0e6030552b6/06879854-6c57-41cd-aef1-64f16a79c337) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:33.558387 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-7e397d2e-d5ba-40c3-8051-57991a288ab3', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:14:33.559597 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.573158 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47622) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:33.577386 dv-cinder-818037-8-iscsi neutron-server[102571]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 14 03:14:33.585259 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.634835 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a62aca0a-c858-4f07-93df-13b0fce001cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.640995 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a62aca0a-c858-4f07-93df-13b0fce001cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.737305 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a62aca0a-c858-4f07-93df-13b0fce001cb admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=09a1ffd85f2d46bb8964cfdfca6680e0&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0378973 Dec 14 03:14:33.738344 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47624) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:33.741254 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a62aca0a-c858-4f07-93df-13b0fce001cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5610c0f8-0387-424e-8e75-a048e4ac0cdc,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:33.825114 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Allocated IP 172.20.0.2 (7e397d2e-d5ba-40c3-8051-57991a288ab3/cc81a563-179d-4cba-977d-84ceacabb0ec/87620883-93e1-4b22-b4ff-c8fabbab793b) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:33.854069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.865698 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-fede610b-6ac4-4bb1-a8bd-08c83d0f861f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:33.867259 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-fede610b-6ac4-4bb1-a8bd-08c83d0f861f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/networks?id=adc7b7f7-be75-4e68-a215-6654c2c27cac HTTP/1.1" status: 200 len: 811 time: 0.2913065 Dec 14 03:14:33.870967 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:33.901206 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-f81a5e5f-514c-4af2-8610-d4925d51da43 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/quotas/7efcbf12d6654bc68690363892415b77 HTTP/1.1" status: 200 len: 375 time: 0.0223930 Dec 14 03:14:33.955838 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.009538 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.048759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.097103 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.099210 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-7efa54c5-fc15-4a22-8501-641ec1b1ffac tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=7efcbf12d6654bc68690363892415b77&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1842692 Dec 14 03:14:34.149589 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.180281 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.241961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.245756 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Pushing event updated for resources: {'Port': ['ID=06879854-6c57-41cd-aef1-64f16a79c337,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:34.258512 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.273771 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Allocated IP 172.27.3.110 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/721bfbf0-cf5b-46fc-803a-1093edc88ca6) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:34.280012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:34.282518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:34.283891 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:34.286273 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.286647 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.287685 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.288028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.288356 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.288728 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.289068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.289308 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.290012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.290209 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.290752 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.291334 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.292330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Tracked resource versions report: Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: pushed versions: Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: { 'AddressGroup': {'1.2'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'ConntrackHelper': {'1.0'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Log': {'1.0'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Network': {'1.1'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Port': {'1.7'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'PortForwarding': {'1.2'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'QosPolicy': {'1.10'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroup': {'1.5'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SubPort': {'1.0'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Subnet': {'1.1'}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Trunk': {'1.1'}} Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: consumer versions: Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: HyperV agent@hv-cinder-81803: {}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'ConntrackHelper': '1.0', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'LocalIPAssociation': '1.0', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Log': '1.0', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Network': '1.1', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Port': '1.7', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'PortForwarding': '1.2', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'QosPolicy': '1.10', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroup': '1.5', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SecurityGroupRule': '1.2', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'SubPort': '1.0', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Subnet': '1.1', Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: 'Trunk': '1.1'}} Dec 14 03:14:34.293247 dv-cinder-818037-8-iscsi neutron-server[102573]: {{(pid=102573) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:14:34.298499 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.307668 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:34.343735 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:34.366762 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-969bf1b2-9925-47fe-bc00-0b586dd5a271 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:14:34.369479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-969bf1b2-9925-47fe-bc00-0b586dd5a271 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1411989 Dec 14 03:14:34.373959 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.375035 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:34.423071 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.450372 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Attempting to bind port 87620883-93e1-4b22-b4ff-c8fabbab793b on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:34.450746 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Attempting to bind port 87620883-93e1-4b22-b4ff-c8fabbab793b by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:34.451128 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Attempting to bind port 87620883-93e1-4b22-b4ff-c8fabbab793b on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:34.466578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Pushing event updated for resources: {'Port': ['ID=87620883-93e1-4b22-b4ff-c8fabbab793b,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:34.488416 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:34.488871 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Checking segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:34.489272 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.489663 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Bound using segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:34.490250 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Bound port: 87620883-93e1-4b22-b4ff-c8fabbab793b, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:34.499438 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.528819 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Attempting to bind port 06879854-6c57-41cd-aef1-64f16a79c337 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:34.529457 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Attempting to bind port 06879854-6c57-41cd-aef1-64f16a79c337 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:34.530126 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Attempting to bind port 06879854-6c57-41cd-aef1-64f16a79c337 on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:34.536143 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Allocated IP 172.27.3.213 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/a0d1af4b-c83d-4269-869f-8940b01220a7) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:34.575314 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:34.576359 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Checking segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:34.577787 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.578350 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Bound using segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:34.579018 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Bound port: 06879854-6c57-41cd-aef1-64f16a79c337, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:34.580092 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.626054 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.627135 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.631300 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.635348 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5610c0f8-0387-424e-8e75-a048e4ac0cdc HTTP/1.1" status: 204 len: 168 time: 0.8863590 Dec 14 03:14:34.656413 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] For port 87620883-93e1-4b22-b4ff-c8fabbab793b, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:34.664636 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] For port 87620883-93e1-4b22-b4ff-c8fabbab793b, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=87620883-93e1-4b22-b4ff-c8fabbab793b,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:34.666297 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cefdfcf-9893-490d-a5a9-66a658d30785 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5610c0f8-0387-424e-8e75-a048e4ac0cdc,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:34.700215 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-e041c89d-4658-41c2-9c9f-1ec6ba9f4db6 service neutron] 10.222.0.43 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3180516 Dec 14 03:14:34.717800 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.732291 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Pushing event updated for resources: {'Port': ['ID=721bfbf0-cf5b-46fc-803a-1093edc88ca6,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:34.746240 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:34.753174 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:34.756816 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:34.759199 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] For port 06879854-6c57-41cd-aef1-64f16a79c337, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:34.884535 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] For port 06879854-6c57-41cd-aef1-64f16a79c337, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=06879854-6c57-41cd-aef1-64f16a79c337,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:34.892309 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-ab49160d-5e05-461d-8961-33edf9b0e3e6 service neutron] 10.222.0.43 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1905136 Dec 14 03:14:34.937172 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:34.965292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.007146 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14a6d06-2468-43ec-9cdb-6882853fb504 None None] Pushing event updated for resources: {'Port': ['ID=87620883-93e1-4b22-b4ff-c8fabbab793b,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:35.175584 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d3a45d-098d-47e4-b773-52757f485d5d None None] Pushing event updated for resources: {'Port': ['ID=06879854-6c57-41cd-aef1-64f16a79c337,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:35.310347 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47686) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:35.326802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f4741c0-bda7-41a6-9d8e-079486193e03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.460221 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.485679 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47696) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:35.535064 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:35.536203 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.618194 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0bd755c-7cc9-42f7-980a-9bc08d1fa53c req-eea1e1be-aefa-4cfc-a35b-48130c682b22 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.1159408 Dec 14 03:14:35.664412 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f4741c0-bda7-41a6-9d8e-079486193e03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.678687 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f4741c0-bda7-41a6-9d8e-079486193e03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:35.681348 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:35.684920 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Allocated IP 172.27.3.200 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/0b0ac22c-ca16-4003-a9db-fd8193f4582a) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:35.698664 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Pushing event updated for resources: {'Port': ['ID=a0d1af4b-c83d-4269-869f-8940b01220a7,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:35.717990 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:35.856194 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4741c0-bda7-41a6-9d8e-079486193e03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c91933e-01b9-4429-9588-8900504d24dd,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:35.880040 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3f4741c0-bda7-41a6-9d8e-079486193e03 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c22a29cbd3d44acba66774b6372ac2c7&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5685201 Dec 14 03:14:35.884923 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47706) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:36.009462 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.056953 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.107101 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 06879854-6c57-41cd-aef1-64f16a79c337 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:36.150855 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.197049 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 06879854-6c57-41cd-aef1-64f16a79c337 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:36.197465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.257538 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.322629 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.331634 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.405613 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.409480 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.414656 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0c91933e-01b9-4429-9588-8900504d24dd HTTP/1.1" status: 204 len: 168 time: 0.5287869 Dec 14 03:14:36.436103 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 06879854-6c57-41cd-aef1-64f16a79c337, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=06879854-6c57-41cd-aef1-64f16a79c337,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:36.451413 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.454712 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 87620883-93e1-4b22-b4ff-c8fabbab793b up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:36.477896 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df84a612-c70e-44d6-a091-b5bdeae2797f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c91933e-01b9-4429-9588-8900504d24dd,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:36.540147 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.785300 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:36.828016 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:36.856515 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=06879854-6c57-41cd-aef1-64f16a79c337,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:36.864231 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:36.902053 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 87620883-93e1-4b22-b4ff-c8fabbab793b triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:36.902818 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:36.912503 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Router efa90d3f-db01-404e-ab49-7a4127455630 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102572) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:14:36.975098 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c123422d-6f6b-4cb3-bac0-0999882f8595 None None] Network 61e8c126-6b7d-4549-9293-90629e6175d3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:36.995640 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6c28f85-8d95-4f6e-b684-8955fdb2c062 req-e653772e-849e-40c3-a64d-8aad7c4d9131 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.1369979 Dec 14 03:14:37.149483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Pushing event updated for resources: {'Port': ['ID=0b0ac22c-ca16-4003-a9db-fd8193f4582a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:37.225095 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:37.249652 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:37.260064 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:37.288627 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:37.289506 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:37.375326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-3105cf80-cbdb-4db1-ada4-8009bc1ab4b2 None None] Provisioning complete for port 06879854-6c57-41cd-aef1-64f16a79c337 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:37.375910 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3105cf80-cbdb-4db1-ada4-8009bc1ab4b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:37.400648 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47774) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:37.414982 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:37.417607 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-babcb317-4cb1-41a1-a311-a21245c42e91 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.8617370 Dec 14 03:14:37.430097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47784) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:37.471325 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b0367d4-5256-4cd3-914f-625ec38a73bb None None] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:14:37.617880 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:37.846387 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:34Z', 'revision_number': 3, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:37.889438 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:37.890193 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Updating router efa90d3f-db01-404e-ab49-7a4127455630 port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:37.891007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:37.918982 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.028858 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47798) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:38.174724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 87620883-93e1-4b22-b4ff-c8fabbab793b, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=87620883-93e1-4b22-b4ff-c8fabbab793b,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:38.187263 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.226864 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a46fc4f7-c41b-49a7-a582-d1fb4187b626 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.332474 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Router 5e9dc0da-1e5d-4792-b837-a8f826984a14 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102572) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:14:38.428820 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 06879854-6c57-41cd-aef1-64f16a79c337 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:38.456331 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.600573 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-19139b7a-ca9b-4196-b012-108c98d95ef5 None None] Provisioning complete for port 87620883-93e1-4b22-b4ff-c8fabbab793b triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:38.600852 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-19139b7a-ca9b-4196-b012-108c98d95ef5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.629254 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 req-90d9c5f8-3c0f-440e-a02e-674d79baed12 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.0980165 Dec 14 03:14:38.676085 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=87620883-93e1-4b22-b4ff-c8fabbab793b,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:38.791656 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.799614 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.868638 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 06879854-6c57-41cd-aef1-64f16a79c337 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:38.869031 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.928162 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Pushing event updated for resources: {'Port': ['ID=721bfbf0-cf5b-46fc-803a-1093edc88ca6,revision_number=2']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:38.936541 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Attempting to bind port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:38.937331 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Attempting to bind port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:38.937900 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Attempting to bind port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:38.949526 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.950215 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.950770 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.951300 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.951845 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.953149 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.953659 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.954824 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.955430 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.956209 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.958021 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.963273 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.963866 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Tracked resource versions report: Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: pushed versions: Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: { 'AddressGroup': {'1.2'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'ConntrackHelper': {'1.0'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'LocalIPAssociation': {'1.0'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Log': {'1.0'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Network': {'1.1'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Port': {'1.7'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'PortForwarding': {'1.2'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'QosPolicy': {'1.10'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroup': {'1.5'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroupRule': {'1.2'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SubPort': {'1.0'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Subnet': {'1.1'}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Trunk': {'1.1'}} Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: consumer versions: Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: { DHCP agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: HyperV agent@hv-cinder-81803: {}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: L3 agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: Metadata agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: Metering agent@dv-cinder-818037-8-iscsi: {}, Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: Open vSwitch agent@dv-cinder-818037-8-iscsi: { 'AddressGroup': '1.2', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'ConntrackHelper': '1.0', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'LocalIPAssociation': '1.0', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Log': '1.0', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Network': '1.1', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Port': '1.7', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'PortForwarding': '1.2', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'QosPolicy': '1.10', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroup': '1.5', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SecurityGroupRule': '1.2', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'SubPort': '1.0', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Subnet': '1.1', Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: 'Trunk': '1.1'}} Dec 14 03:14:38.968318 dv-cinder-818037-8-iscsi neutron-server[102574]: {{(pid=102574) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 14 03:14:38.974013 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a46fc4f7-c41b-49a7-a582-d1fb4187b626 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.981125 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:38.982849 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.983404 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:38.985718 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.986934 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:38.989089 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Bound port: 721bfbf0-cf5b-46fc-803a-1093edc88ca6, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:38.989813 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:38.992382 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-aaa65004-2035-4f63-9a67-780007241bb1 None None] Provisioning complete for port 06879854-6c57-41cd-aef1-64f16a79c337 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:38.992889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-aaa65004-2035-4f63-9a67-780007241bb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.006117 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a46fc4f7-c41b-49a7-a582-d1fb4187b626 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.107553 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] For port 721bfbf0-cf5b-46fc-803a-1093edc88ca6, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:39.111594 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] For port 721bfbf0-cf5b-46fc-803a-1093edc88ca6, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=721bfbf0-cf5b-46fc-803a-1093edc88ca6,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:39.115714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f679e0a3-1e6c-4e22-9aa5-db98bf1a5a31 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.117954 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.126125 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:39.139556 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a46fc4f7-c41b-49a7-a582-d1fb4187b626 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3978e85ac345454a9f286c57ac62f7cb&name=default HTTP/1.1" status: 200 len: 2992 time: 1.7335081 Dec 14 03:14:39.149808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Sync routers for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:39.153024 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47834) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:39.178311 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:39.179271 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:39.226892 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.232743 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-287d3cd7-293c-417b-b5b1-f40f3c24349c admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 6.4891393 Dec 14 03:14:39.232954 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b252b5f-8569-4e68-9136-c3e3f8473506 None None] Pushing event updated for resources: {'Port': ['ID=721bfbf0-cf5b-46fc-803a-1093edc88ca6,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:39.257111 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:39.257849 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:39.330209 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47838) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:39.362555 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46fc4f7-c41b-49a7-a582-d1fb4187b626 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b915e3fd-703d-4015-a15c-102c937d5709,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:39.381070 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.20', 53459) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:39.437572 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:39.440585 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.454187 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:39.777241 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-aaa65004-2035-4f63-9a67-780007241bb1 None None] Provisioning complete for port 87620883-93e1-4b22-b4ff-c8fabbab793b triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:39.780271 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-aaa65004-2035-4f63-9a67-780007241bb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:39.846206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-fd073fd0-3073-4385-a2a0-62572489a37a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:39.848138 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-fd073fd0-3073-4385-a2a0-62572489a37a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.20 "GET /v2.0/networks?id=adc7b7f7-be75-4e68-a215-6654c2c27cac HTTP/1.1" status: 200 len: 811 time: 0.4654689 Dec 14 03:14:39.858290 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:34Z', 'revision_number': 3, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:39.948072 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-638419cf-365d-48f7-8ff4-abd58a71e1e2 None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:34Z', 'revision_number': 3, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:40.067917 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Request body: {'port': {'device_id': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac', 'admin_state_up': True, 'tenant_id': '7efcbf12d6654bc68690363892415b77'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:40.102819 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.159546 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:35Z', 'revision_number': 3, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:40.205464 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Checking router: 5e9dc0da-1e5d-4792-b837-a8f826984a14 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:40.205829 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Updating router 5e9dc0da-1e5d-4792-b837-a8f826984a14 port a0d1af4b-c83d-4269-869f-8940b01220a7 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:40.222627 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f679e0a3-1e6c-4e22-9aa5-db98bf1a5a31 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.257584 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.284228 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.289447 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f679e0a3-1e6c-4e22-9aa5-db98bf1a5a31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.336560 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f727ab7f-4d27-4c20-8795-2c91dc848004 req-c90550fe-787c-40b1-a3e7-1bae5d8bad61 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.1174364 Dec 14 03:14:40.486754 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 87620883-93e1-4b22-b4ff-c8fabbab793b up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:40.496667 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Allocated IP 172.20.0.1 (61e8c126-6b7d-4549-9293-90629e6175d3/8711f032-5b57-4823-aa19-b0e6030552b6/4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:40.530083 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f679e0a3-1e6c-4e22-9aa5-db98bf1a5a31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c3e9197-fda1-4138-843e-a4977d136980,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:40.565486 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f679e0a3-1e6c-4e22-9aa5-db98bf1a5a31 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d7fdc9b85ec14982acc0d7e45db100d8&name=default HTTP/1.1" status: 200 len: 2992 time: 2.5349371 Dec 14 03:14:40.570966 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 47908) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:40.631869 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.686393 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.779427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:40.789973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:40.796542 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 87620883-93e1-4b22-b4ff-c8fabbab793b triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:40.797850 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.797976 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:40.798167 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.802341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Pushing event updated for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:40.859235 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Made reservation on behalf of 7efcbf12d6654bc68690363892415b77 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:40.862970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.876173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.890086 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102571) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:14:40.922275 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.925845 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:40.929939 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b915e3fd-703d-4015-a15c-102c937d5709 HTTP/1.1" status: 204 len: 168 time: 1.7655566 Dec 14 03:14:41.033653 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50659bcb-7a70-4d9f-9726-46fa198c6a9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b915e3fd-703d-4015-a15c-102c937d5709,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:41.184128 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.259664 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Allocated IP 172.20.0.3 (adc7b7f7-be75-4e68-a215-6654c2c27cac/54fa88c0-5b07-4018-9346-f1d3f6f3df1d/9f8a517f-1b7e-4db6-ab49-7f2896db6aed) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:41.346335 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.406093 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-9adb6335-498d-4b00-93e3-79733f619d30 None None] Provisioning complete for port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:41.406468 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9adb6335-498d-4b00-93e3-79733f619d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.442243 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.538845 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-9adb6335-498d-4b00-93e3-79733f619d30 None None] Port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:14:41.553554 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.565280 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.733804 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f7461e-3eb1-44bc-9f78-78775c86324e None None] Pushing event updated for resources: {'Port': ['ID=a0d1af4b-c83d-4269-869f-8940b01220a7,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:41.744979 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Attempting to bind port a0d1af4b-c83d-4269-869f-8940b01220a7 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:41.745355 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Attempting to bind port a0d1af4b-c83d-4269-869f-8940b01220a7 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:41.745729 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Attempting to bind port a0d1af4b-c83d-4269-869f-8940b01220a7 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:41.780527 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:41.780910 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:41.781312 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.781720 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:41.782219 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Bound port: a0d1af4b-c83d-4269-869f-8940b01220a7, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:41.825436 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.847700 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.859164 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.860008 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8c3e9197-fda1-4138-843e-a4977d136980 HTTP/1.1" status: 204 len: 168 time: 1.2850130 Dec 14 03:14:41.883875 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3cabec72-acf7-4311-a4eb-11ae44979463 req-ce2d6619-0576-4e89-a233-c40320bcf821 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.1946590 Dec 14 03:14:41.917853 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] For port a0d1af4b-c83d-4269-869f-8940b01220a7, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:41.921245 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] For port a0d1af4b-c83d-4269-869f-8940b01220a7, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=a0d1af4b-c83d-4269-869f-8940b01220a7,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:41.932168 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:41.947113 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb14343-b5d0-4da7-ba69-b46e13b17680 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c3e9197-fda1-4138-843e-a4977d136980,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:41.969243 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:41.986882 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:42.033604 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:42.036175 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:42.054897 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Allocated IP 172.20.0.1 (b4af40aa-6be1-48c2-866d-05aa1bdec9d3/2088257b-adb7-490f-afb9-fe03d7b4ad30/1b9553c4-78d4-462f-a94a-3ea34b003fd3) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:42.103962 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:42.104607 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:42.106447 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f7461e-3eb1-44bc-9f78-78775c86324e None None] Pushing event updated for resources: {'Port': ['ID=a0d1af4b-c83d-4269-869f-8940b01220a7,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:42.158871 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:42.163204 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3e8e9eb6-3d1c-4a21-a4d9-2db2bd8b5676 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 9.1573043 Dec 14 03:14:42.166085 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47948) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:42.315357 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:42.433964 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:42.445165 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:42.459429 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:42.495581 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 721bfbf0-cf5b-46fc-803a-1093edc88ca6 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:42.878881 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 47958) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:42.885775 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:42.895708 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:42.919532 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:37Z', 'revision_number': 3, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:42.963559 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:42.964120 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.011316 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.019987 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:43.021964 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Updating router 1730ffec-70d3-4fe6-b3d1-76f550a253ce port 0b0ac22c-ca16-4003-a9db-fd8193f4582a binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:43.101406 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.149280 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Pushing event updated for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:43.210879 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:43.220774 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:43.222653 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.228786 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:43.229424 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.263121 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 721bfbf0-cf5b-46fc-803a-1093edc88ca6, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=721bfbf0-cf5b-46fc-803a-1093edc88ca6,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:43.280746 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.347378 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=721bfbf0-cf5b-46fc-803a-1093edc88ca6,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:43.355800 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f2bae2a-f3c1-4f5c-9800-147222b2aa6d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.383730 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:35Z', 'revision_number': 3, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:43.452750 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee4cbe-332f-42e9-a052-4d381506e409 None None] The sync data for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi is: [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:35Z', 'revision_number': 3, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:43.554642 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17e5167-271c-4bb0-89fe-5d65dff50eef req-3131ebe0-6650-46e3-a763-70fc9ac131ca tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:43.562194 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b17e5167-271c-4bb0-89fe-5d65dff50eef req-3131ebe0-6650-46e3-a763-70fc9ac131ca tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 931 time: 0.4553707 Dec 14 03:14:43.582018 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.606866 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.608959 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.648144 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Network adc7b7f7-be75-4e68-a215-6654c2c27cac is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:43.672121 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Pushing event updated for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:43.731859 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:43.777673 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:43.789370 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:43.791737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:43.970268 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b17e5167-271c-4bb0-89fe-5d65dff50eef req-7e1863db-7aa5-415c-af0b-07b13943d0c8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3840818 Dec 14 03:14:44.054773 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-59675b88-ca8a-4ac3-84bc-0d6c5db73cc5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.9944925 Dec 14 03:14:44.072311 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.079528 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.105278 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.208917 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b438ff4-6d54-4d19-8aad-e2c5be9c2a34 None None] Pushing event updated for resources: {'Port': ['ID=0b0ac22c-ca16-4003-a9db-fd8193f4582a,revision_number=2']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:44.226503 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Attempting to bind port 0b0ac22c-ca16-4003-a9db-fd8193f4582a on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:44.232450 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Attempting to bind port 0b0ac22c-ca16-4003-a9db-fd8193f4582a by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:44.233033 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Attempting to bind port 0b0ac22c-ca16-4003-a9db-fd8193f4582a on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:44.244742 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:44.245403 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:44.245949 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.246491 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:44.248163 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Bound port: 0b0ac22c-ca16-4003-a9db-fd8193f4582a, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:44.248806 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.278456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Pushing event updated for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:44.308456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-acf6248a-3086-4056-806a-fb032d585f02 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:14:44.309724 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-acf6248a-3086-4056-806a-fb032d585f02 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0109129 Dec 14 03:14:44.399573 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] For port 0b0ac22c-ca16-4003-a9db-fd8193f4582a, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:44.404323 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] For port 0b0ac22c-ca16-4003-a9db-fd8193f4582a, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=0b0ac22c-ca16-4003-a9db-fd8193f4582a,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:44.412252 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.474745 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:44.495953 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f2bae2a-f3c1-4f5c-9800-147222b2aa6d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.500237 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:44.516197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f2bae2a-f3c1-4f5c-9800-147222b2aa6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.574760 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b438ff4-6d54-4d19-8aad-e2c5be9c2a34 None None] Pushing event updated for resources: {'Port': ['ID=0b0ac22c-ca16-4003-a9db-fd8193f4582a,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:44.691937 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:44.693677 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device a0d1af4b-c83d-4269-869f-8940b01220a7 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:44.695442 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:44.719081 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.739245 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.739245 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.890602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port a0d1af4b-c83d-4269-869f-8940b01220a7 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:44.891653 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:44.986323 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:45.051639 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Pushing event updated for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:45.076864 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-4f2bae2a-f3c1-4f5c-9800-147222b2aa6d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3af55fe172424f0697f23b6098078253&name=default HTTP/1.1" status: 200 len: 2992 time: 2.1968915 Dec 14 03:14:45.078167 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48008) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:45.134796 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:45.198214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f2bae2a-f3c1-4f5c-9800-147222b2aa6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b4d0de5-ebfe-4c39-8523-836ff84a4696,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:45.258076 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port a0d1af4b-c83d-4269-869f-8940b01220a7, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=a0d1af4b-c83d-4269-869f-8940b01220a7,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:45.283762 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-707e8bd8-68eb-4ad3-9934-472254d5b1b6 None None] Provisioning complete for port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:45.284206 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-707e8bd8-68eb-4ad3-9934-472254d5b1b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:45.321970 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:45.328615 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:45.409084 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-707e8bd8-68eb-4ad3-9934-472254d5b1b6 None None] Port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:14:45.412094 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:45.412888 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 721bfbf0-cf5b-46fc-803a-1093edc88ca6 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:45.593193 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:37Z', 'revision_number': 3, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:45.670746 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b907c999-f89f-4812-817c-00e798c532a3 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:37Z', 'revision_number': 3, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:45.706855 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48030) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:45.712342 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=a0d1af4b-c83d-4269-869f-8940b01220a7,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:45.712802 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Request body: {'port': {'device_id': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:45.749981 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:45.750362 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:45.796385 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Router 5e9dc0da-1e5d-4792-b837-a8f826984a14 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:14:45.824060 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16adb56e-cc90-4873-a800-bd502cfaca1e req-fd7413b4-1332-4c5c-b001-df6a62c22338 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:45.847685 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-16adb56e-cc90-4873-a800-bd502cfaca1e req-fd7413b4-1332-4c5c-b001-df6a62c22338 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 931 time: 0.5556469 Dec 14 03:14:45.888729 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:45.966058 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-372da985-d90a-44e3-bc07-3d917e6a9e12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.126847 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-16adb56e-cc90-4873-a800-bd502cfaca1e req-4f157a3d-f056-4529-9a5b-cd83080a43eb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2782795 Dec 14 03:14:46.225813 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:46.234889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-58d889fb-5157-4e5e-826a-85f0bb217baa admin admin] 10.222.0.43 "PUT /v2.0/routers/5e9dc0da-1e5d-4792-b837-a8f826984a14/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9032876 Dec 14 03:14:46.332886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-372da985-d90a-44e3-bc07-3d917e6a9e12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.341643 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-372da985-d90a-44e3-bc07-3d917e6a9e12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.466715 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-372da985-d90a-44e3-bc07-3d917e6a9e12 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9ee92ea1c1534fa4b7c1d28398d8d31b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7502217 Dec 14 03:14:46.467566 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372da985-d90a-44e3-bc07-3d917e6a9e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f58afa6-516a-453c-afc1-ac3682cd6d46,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:46.469944 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48050) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:46.553065 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.688216 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 0b0ac22c-ca16-4003-a9db-fd8193f4582a up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:46.690878 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.708158 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.730563 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.772859 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 0b0ac22c-ca16-4003-a9db-fd8193f4582a triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:46.774010 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.805074 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.810886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.816890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1f58afa6-516a-453c-afc1-ac3682cd6d46 HTTP/1.1" status: 204 len: 168 time: 0.3457522 Dec 14 03:14:46.839283 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ca7820-8b63-4f82-b8de-ec8b79ff9523 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f58afa6-516a-453c-afc1-ac3682cd6d46,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:46.860879 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:14:46.880915 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:46.970064 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:47.004012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 0b0ac22c-ca16-4003-a9db-fd8193f4582a, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=0b0ac22c-ca16-4003-a9db-fd8193f4582a,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:47.027240 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:47.031410 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device a0d1af4b-c83d-4269-869f-8940b01220a7 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:47.346718 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=0b0ac22c-ca16-4003-a9db-fd8193f4582a,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:47.451126 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port a0d1af4b-c83d-4269-869f-8940b01220a7 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:47.456831 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:47.501262 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-26678e86-8610-4f83-90df-52d40ef72667 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:47.513252 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-26678e86-8610-4f83-90df-52d40ef72667 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 818 time: 0.3587210 Dec 14 03:14:47.533712 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Sync routers for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:47.562463 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:47.563540 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:47.564139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-32c79312-8d22-4e60-9b1c-4eba8f78ce35 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/quotas/bb4be946dd9b4b2080fb3b398521624e HTTP/1.1" status: 200 len: 375 time: 0.0488160 Dec 14 03:14:47.796055 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:47.823215 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a req-d40ee530-97d4-41f4-a283-a32fcc956313 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:47.842247 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a req-d40ee530-97d4-41f4-a283-a32fcc956313 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 931 time: 0.4964569 Dec 14 03:14:47.885498 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-7482378f-4c71-4662-8cb7-96ba8dbce7a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3203244 Dec 14 03:14:47.997716 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a req-66b558d5-808a-4e71-8c62-ca713dca2c55 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334641 Dec 14 03:14:48.048891 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48104) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:48.086511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9f8a517f-1b7e-4db6-ab49-7f2896db6aed {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:14:48.114461 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.235502 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Transition to ACTIVE for port object 9f8a517f-1b7e-4db6-ab49-7f2896db6aed will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:14:48.321673 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.356226 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.362312 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2b4d0de5-ebfe-4c39-8523-836ff84a4696 HTTP/1.1" status: 204 len: 168 time: 3.1659708 Dec 14 03:14:48.390632 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-45d13671-bcab-45d0-a891-8dfe0cd31178 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.396653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.448319 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 0b0ac22c-ca16-4003-a9db-fd8193f4582a up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:48.499208 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-7fdf4c9f-50fa-48ac-a854-bbe56e6d0b19 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:14:48.500895 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-7fdf4c9f-50fa-48ac-a854-bbe56e6d0b19 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1479061 Dec 14 03:14:48.511485 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cae9168-5f9e-490c-b98d-367ba3a47237 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b4d0de5-ebfe-4c39-8523-836ff84a4696,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:48.646823 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:48.662548 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:48.678142 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a5ace5e9-79bf-4ef0-969b-8605ef7111b9 admin admin] 10.222.0.43 "PUT /v2.0/routers/efa90d3f-db01-404e-ab49-7a4127455630/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.2450082 Dec 14 03:14:48.683986 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Pushing event updated for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:48.706322 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:48.706973 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:48.778635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 0b0ac22c-ca16-4003-a9db-fd8193f4582a triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:48.779022 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.897926 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Attempting to bind port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:48.898689 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Attempting to bind port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '45d9b456-a3f1-4779-951e-75d07e818a26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:48.899221 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Attempting to bind port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed on network adc7b7f7-be75-4e68-a215-6654c2c27cac {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:48.912270 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed on network adc7b7f7-be75-4e68-a215-6654c2c27cac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:14:48.912837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Attempting to bind port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed on network adc7b7f7-be75-4e68-a215-6654c2c27cac {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:48.928086 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:48.929132 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Checking segment: {'id': '45d9b456-a3f1-4779-951e-75d07e818a26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:48.930446 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Bound using segment: {'id': '45d9b456-a3f1-4779-951e-75d07e818a26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:48.931437 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Bound port: 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45d9b456-a3f1-4779-951e-75d07e818a26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:48.931965 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:48.951506 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-0df4c577-afc1-4a76-9886-1548ab7715dd service neutron] 10.222.0.43 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4400768 Dec 14 03:14:48.955017 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Allocated IP 172.20.0.1 (7e397d2e-d5ba-40c3-8051-57991a288ab3/cc81a563-179d-4cba-977d-84ceacabb0ec/72b484c2-b432-4085-96b7-6249ec75de2d) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:49.087013 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-45d13671-bcab-45d0-a891-8dfe0cd31178 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.119825 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-45d13671-bcab-45d0-a891-8dfe0cd31178 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.157498 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:49.211416 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-8fae4eca-c416-4ea7-b5c5-bff6b019646a service neutron] 10.222.0.43 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2587450 Dec 14 03:14:49.235726 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:49.272333 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,segment=NetworkSegment(45d9b456-a3f1-4779-951e-75d07e818a26),segment_id=45d9b456-a3f1-4779-951e-75d07e818a26)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:49.325951 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.340567 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-45d13671-bcab-45d0-a891-8dfe0cd31178 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=241f70f0c752454fad3f39dcca6f9bc3&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2903876 Dec 14 03:14:49.344203 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48142) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:49.364654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1b9553c4-78d4-462f-a94a-3ea34b003fd3', 'name': '', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'mac_address': 'fa:16:3e:54:14:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:41Z', 'updated_at': '2021-12-14T03:14:44Z', 'revision_number': 2, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'subnets': [{'id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:49.374109 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d13671-bcab-45d0-a891-8dfe0cd31178 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1e0a8b5-258a-456f-a297-a6e466bbdd3d,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:49.469313 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Checking router: 5e9dc0da-1e5d-4792-b837-a8f826984a14 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:49.470299 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Updating router 5e9dc0da-1e5d-4792-b837-a8f826984a14 port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:49.524311 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1ec690-8276-4045-a2f3-9a7803563643 req-38596624-703c-4d4a-a6b1-36a2e6448bfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:49.527977 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b1ec690-8276-4045-a2f3-9a7803563643 req-38596624-703c-4d4a-a6b1-36a2e6448bfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.3154495 Dec 14 03:14:49.529653 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.742041 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.771550 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 2, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:49.776484 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b1ec690-8276-4045-a2f3-9a7803563643 req-f5ef6e5f-d6b0-4afb-b5b4-5c079d3da197 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2337389 Dec 14 03:14:49.836686 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.872532 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.916221 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Pushing event updated for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:49.932637 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:49.983452 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:49.984347 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Updating router efa90d3f-db01-404e-ab49-7a4127455630 port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:50.052607 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.082204 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Pushing event updated for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:50.098886 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:50.099523 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.120995 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c864d7b-2008-4ab8-8f23-ae9df45e5cdd req-f01af0c2-1aec-42f5-b099-dfa53a241520 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 210 time: 0.2097631 Dec 14 03:14:50.142286 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e8a35c54-c65a-4f4f-b80a-3a4502aa6652 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.142800 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-13eff3a8-a427-428b-98b5-c25c2f021a7b service neutron] 10.222.0.20 "PUT /v2.0/ports/9f8a517f-1b7e-4db6-ab49-7f2896db6aed HTTP/1.1" status: 200 len: 1093 time: 4.8513231 Dec 14 03:14:50.143749 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:14:50.162990 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.165746 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.169410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a1e0a8b5-258a-456f-a297-a6e466bbdd3d HTTP/1.1" status: 204 len: 168 time: 0.8217654 Dec 14 03:14:50.190631 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db83caed-74b6-415e-8db2-f9b66fe89290 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1e0a8b5-258a-456f-a297-a6e466bbdd3d,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:50.508318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:50.531707 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:50.538059 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:50.538876 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.559009 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.565952 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.753026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-ebdb9ae2-7f8b-410e-9fbc-efdc0120d588 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:50.755920 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-ebdb9ae2-7f8b-410e-9fbc-efdc0120d588 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7efcbf12d6654bc68690363892415b77&device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 1096 time: 0.4095061 Dec 14 03:14:50.873080 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f16cbc9-a94c-4d43-b810-0641b3709617 None None] Pushing event updated for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:50.891960 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Attempting to bind port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:50.892599 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Attempting to bind port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:50.893179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Attempting to bind port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:50.899815 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:50.900778 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Checking segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:50.901427 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:50.902036 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Bound using segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:50.902736 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Bound port: 1b9553c4-78d4-462f-a94a-3ea34b003fd3, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:50.903387 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.058259 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] For port 1b9553c4-78d4-462f-a94a-3ea34b003fd3, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:51.068408 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] For port 1b9553c4-78d4-462f-a94a-3ea34b003fd3, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1b9553c4-78d4-462f-a94a-3ea34b003fd3,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:51.079454 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.222887 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-4ef94638-1464-4a93-a144-59c746ea4dc2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:51.229246 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.238484 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-4ef94638-1464-4a93-a144-59c746ea4dc2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 818 time: 0.2861660 Dec 14 03:14:51.246608 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.258892 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-f7fb171c-9d44-4d15-ae75-a5619c0e6b15 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed HTTP/1.1" status: 200 len: 217 time: 0.3228898 Dec 14 03:14:51.272336 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-32d7ac06-fa6a-45aa-b792-91106ff257d0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/quotas/bb4be946dd9b4b2080fb3b398521624e HTTP/1.1" status: 200 len: 375 time: 0.0305748 Dec 14 03:14:51.290697 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:51.291409 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:51.298305 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-07bfa42e-698f-47ef-94c9-a080d000a5ae None None] Provisioning complete for port 72b484c2-b432-4085-96b7-6249ec75de2d triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:51.298732 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-07bfa42e-698f-47ef-94c9-a080d000a5ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.397534 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-2ee53c3e-1df2-4ee6-a512-b0f57e6a0991 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1239355 Dec 14 03:14:51.420823 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.425707 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c49d8f-b86e-4463-9c19-314dea3b703c None None] Pushing event updated for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:51.447270 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48228) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:51.635311 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-07bfa42e-698f-47ef-94c9-a080d000a5ae None None] Port 72b484c2-b432-4085-96b7-6249ec75de2d cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:14:51.651551 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-59e17f35-0a39-4e34-8e40-5787fb3d0fb9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.662341 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f16cbc9-a94c-4d43-b810-0641b3709617 None None] Pushing event updated for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:51.808061 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Attempting to bind port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:51.808465 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Attempting to bind port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:51.812062 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Attempting to bind port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:51.853781 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:51.855425 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Checking segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:51.855845 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.860073 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Bound using segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:51.864280 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Bound port: 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:51.867780 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:51.960479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-5585a109-9477-4370-9197-e47b2d0bc7c8 service neutron] 10.222.0.43 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5619974 Dec 14 03:14:52.052911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:52.117734 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] For port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:52.118939 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.122417 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] For port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:52.123763 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2490bce0-28a4-424b-ab33-c77db2f2d34c" -d '{"events": [{"name": "network-changed", "server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:14:52.139287 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.139447 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.139447 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.278700 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48254) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:52.283157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-e721b2ea-6c9c-4bdd-a3c1-5d8c5fc114b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:52.287705 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-e721b2ea-6c9c-4bdd-a3c1-5d8c5fc114b8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=54fa88c0-5b07-4018-9346-f1d3f6f3df1d HTTP/1.1" status: 200 len: 851 time: 0.8737147 Dec 14 03:14:52.300612 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1499886672', 'description': 'tempest-description--2055989623'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:52.361094 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:52.362445 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:52.369376 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-4e6da68c-1d55-4455-82cd-46c027a9b715 service neutron] 10.222.0.43 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4039876 Dec 14 03:14:52.380395 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b979ea2e-e1e4-4e69-8ed9-d91109f02a70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.577727 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] Provisioning complete for port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:52.582290 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.627839 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-b0f385df-328f-46c2-840d-2087f71c6f16 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=adc7b7f7-be75-4e68-a215-6654c2c27cac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3152997 Dec 14 03:14:52.650432 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-59e17f35-0a39-4e34-8e40-5787fb3d0fb9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.659301 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-59e17f35-0a39-4e34-8e40-5787fb3d0fb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.725420 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cebf74-8d08-4038-8c29-d93d7c93a936 req-e05b0fe4-114c-46f0-be35-a69479920d35 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:52.741274 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84cebf74-8d08-4038-8c29-d93d7c93a936 req-e05b0fe4-114c-46f0-be35-a69479920d35 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.2874422 Dec 14 03:14:52.785943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Pushing event updated for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:52.821393 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c49d8f-b86e-4463-9c19-314dea3b703c None None] Pushing event updated for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:52.907373 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:52.925010 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84cebf74-8d08-4038-8c29-d93d7c93a936 req-936cb42e-8bfa-42b8-b991-434a97b78ee5 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1822054 Dec 14 03:14:52.931622 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e17f35-0a39-4e34-8e40-5787fb3d0fb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2acb37a-5cfa-4dae-8e93-7b6dcb973e4e,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:52.957229 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-59e17f35-0a39-4e34-8e40-5787fb3d0fb9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=cc9f0af4793a478ba83ea3502eb102c7&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4938729 Dec 14 03:14:52.959299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48278) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:53.028630 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:53.224962 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.232783 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-395b803f-76d7-44d3-acbd-a98f45b7439d req-459bf0ee-7e00-4356-a18f-d2b6df7923f6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.1577203 Dec 14 03:14:53.265428 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:53.289038 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-734c9b97-7e96-47ac-b7c7-39c2b9bc84b2 service neutron] 10.222.0.20 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5436385 Dec 14 03:14:53.299475 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:53.389181 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.446821 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.474989 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] For port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:53.505919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.560492 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.20', 53481) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:53.679625 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.688876 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.692843 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f2acb37a-5cfa-4dae-8e93-7b6dcb973e4e HTTP/1.1" status: 204 len: 168 time: 0.7323425 Dec 14 03:14:53.719243 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:14:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b5fa78b-4310-4105-ba78-22234a9505ca x-openstack-request-id: req-6b5fa78b-4310-4105-ba78-22234a9505ca {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:14:53.719548 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:14:53.719813 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6b5fa78b-4310-4105-ba78-22234a9505ca {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:14:53.720254 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed', 'status': 'completed', 'code': 200} Dec 14 03:14:53.828218 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2827e37c-a2c8-4188-9f1c-462afd286527 None None] Pushing event updated for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:53.876908 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:53.887644 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.034365 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c78c80-0c46-4d3e-b695-4c2a7338b8f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2acb37a-5cfa-4dae-8e93-7b6dcb973e4e,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:54.045595 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-e0ed5671-70dd-4156-9169-418878ba84ee None None] Provisioning complete for port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:54.045981 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e0ed5671-70dd-4156-9169-418878ba84ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.264151 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:52Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:54.336408 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-4f43765d-7919-43b3-93c6-560578ba0824 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:54.338121 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-4f43765d-7919-43b3-93c6-560578ba0824 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 818 time: 0.7695014 Dec 14 03:14:54.374204 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1b9553c4-78d4-462f-a94a-3ea34b003fd3', 'name': '', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'mac_address': 'fa:16:3e:54:14:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:41Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'subnets': [{'id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:54.386120 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d427d06-e55e-488c-b144-0e9b18b42d80 None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:52Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:54.417109 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Request body: {'port': {'device_id': '4687b559-c95a-4b82-a076-a7468c10ebef', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'admin_state_up': True, 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:54.647239 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9e741fa-671a-472c-8953-d9b7bff3c3c7 None None] The sync data for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi is: [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1b9553c4-78d4-462f-a94a-3ea34b003fd3', 'name': '', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'mac_address': 'fa:16:3e:54:14:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:41Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'subnets': [{'id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:54.647418 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 req-4fc79656-46ed-400b-a2bf-77941672729a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:54.647418 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 req-4fc79656-46ed-400b-a2bf-77941672729a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.4944375 Dec 14 03:14:54.701793 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48342) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:54.702920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.709799 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.771768 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-e1c54e6c-2fb3-404a-ac87-d1c4fe037c80 None None] Provisioning complete for port 72b484c2-b432-4085-96b7-6249ec75de2d triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:54.774136 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e1c54e6c-2fb3-404a-ac87-d1c4fe037c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.931694 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d73e0963-9a49-463d-9661-74a8ee0523ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.945931 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:54.947482 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-e1c54e6c-2fb3-404a-ac87-d1c4fe037c80 None None] Port 72b484c2-b432-4085-96b7-6249ec75de2d cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:14:54.952356 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 2.6632009 Dec 14 03:14:54.963157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48350) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:54.974191 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group_rule': {'security_group_id': '64e4245c-c105-4dc8-9d60-e655a160fa8f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:54.980502 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9e73012-06e8-4b7b-b702-f574057bebb1 req-1b1efff3-3f5a-45fa-9453-44c2cdb30b4c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.2795768 Dec 14 03:14:55.048062 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 req-d1ba5935-584e-4837-9544-caba82de7788 service neutron] 10.222.0.20 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.7220702 Dec 14 03:14:55.049065 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79bc045e-8b7d-471a-8696-7ca82903f77d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroup': ['ID=64e4245c-c105-4dc8-9d60-e655a160fa8f,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:55.066112 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:14:55.068109 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.297260 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.347371 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d73e0963-9a49-463d-9661-74a8ee0523ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.349892 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.376635 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=99474595-dd6c-461f-b025-f38d57d90d4d,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:55.430904 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d73e0963-9a49-463d-9661-74a8ee0523ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.511235 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.513270 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-018a4fef-84b2-4a8d-82dc-5bfe23b43603 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5453811 Dec 14 03:14:55.517740 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48362) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:55.539695 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group_rule': {'security_group_id': '64e4245c-c105-4dc8-9d60-e655a160fa8f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:55.540616 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d73e0963-9a49-463d-9661-74a8ee0523ec admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a550c996fab444e09c88fd4e8f79e423&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7384071 Dec 14 03:14:55.558882 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48364) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:55.619522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48366) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:55.620682 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 req-5f1286bc-406b-4d42-9e6a-28065343e986 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8241789 Dec 14 03:14:55.656843 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73e0963-9a49-463d-9661-74a8ee0523ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1bc2c28b-fae6-48f6-812e-b9183943d474,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:55.705102 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:14:55.713055 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ca0e338d-f0a7-46b7-9e50-1170aae07c5d admin admin] 10.222.0.43 "PUT /v2.0/routers/1730ffec-70d3-4fe6-b3d1-76f550a253ce/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.5449808 Dec 14 03:14:55.717491 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:14:55.758639 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:55.762995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:55.776291 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.20', 53485) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:55.788646 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:55.827254 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-8d5f5650-1871-4508-aec9-aa2eaa82feae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:55.836869 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-8d5f5650-1871-4508-aec9-aa2eaa82feae service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7efcbf12d6654bc68690363892415b77&device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 1096 time: 0.3433907 Dec 14 03:14:55.922878 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:56.003484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Made reservation on behalf of bb4be946dd9b4b2080fb3b398521624e for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:56.024429 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:56.175473 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:56.538195 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53a3fc08-805a-4148-acfe-1f32d1c5794c req-7245649c-9ac2-4140-af19-7ca1baf962f4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.3302286 Dec 14 03:14:56.639071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:56.750302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:56.821904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-35b83cd3-6d45-477f-b21f-9cbba6b33793 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:56.828093 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-35b83cd3-6d45-477f-b21f-9cbba6b33793 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 818 time: 0.9889910 Dec 14 03:14:56.857922 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-75553d58-e7fe-4b92-9288-f89732c87593 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:56.892818 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:56.893872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:56.921852 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Request body: {'port': {'device_id': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'admin_state_up': True, 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:56.994063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.017182 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.087707 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.170797 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5bd8660-5e8e-43f4-bae3-22af552848cb req-4fe350ae-a3d9-4df9-9c62-df69177cc1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:57.179859 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5bd8660-5e8e-43f4-bae3-22af552848cb req-4fe350ae-a3d9-4df9-9c62-df69177cc1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.3340333 Dec 14 03:14:57.206710 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.228073 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.231460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1bc2c28b-fae6-48f6-812e-b9183943d474 HTTP/1.1" status: 204 len: 168 time: 1.6671021 Dec 14 03:14:57.259902 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f5ae6397-7d06-411e-81ad-578c6b91ab15,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:57.262121 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48412) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:57.289229 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1831167770', 'description': 'tempest-description--476481157'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:57.290921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Allocated IP 172.20.0.8 (b4af40aa-6be1-48c2-866d-05aa1bdec9d3/2088257b-adb7-490f-afb9-fe03d7b4ad30/9d0f1802-5b85-4dd7-847f-3cdd0b182adf) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:57.322204 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 2, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:57.352792 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ffd3fd-5c6d-455a-a31c-3ff749fe27b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bc2c28b-fae6-48f6-812e-b9183943d474,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:57.366766 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.402041 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:14:57.402379 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Updating router 1730ffec-70d3-4fe6-b3d1-76f550a253ce port 72b484c2-b432-4085-96b7-6249ec75de2d binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:14:57.490069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1b9553c4-78d4-462f-a94a-3ea34b003fd3 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:14:57.519178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.536145 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.628659 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.645498 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5bd8660-5e8e-43f4-bae3-22af552848cb req-7c635747-64e8-443c-a9fd-80f82eb16dab tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4645717 Dec 14 03:14:57.693151 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.694394 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.4099774 Dec 14 03:14:57.697982 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48424) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:57.707714 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.713485 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c2658786-0f31-4a1b-b7ea-ae8fe76ae1c6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 2.1896572 Dec 14 03:14:57.713780 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group_rule': {'security_group_id': '47a97fb2-30c0-4223-91ff-a553b95b2269', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:57.717522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-c5d4ccef-9391-4b30-ac98-5c14f20ff254 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:57.718961 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-c5d4ccef-9391-4b30-ac98-5c14f20ff254 service neutron] 10.222.0.20 "GET /v2.0/networks?id=adc7b7f7-be75-4e68-a215-6654c2c27cac HTTP/1.1" status: 200 len: 912 time: 1.8256533 Dec 14 03:14:57.727770 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48426) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:57.765961 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:57.778609 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-319e6fc3-9287-4d94-98b9-19abe5670de2 req-a1901222-4e18-4d77-92c4-5662d8f43c1d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.0409322 Dec 14 03:14:57.780760 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:57.781713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.891264 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:57.965035 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6419ab6-4ad8-4418-aef6-f91b64ce2707 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47a97fb2-30c0-4223-91ff-a553b95b2269,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:57.973302 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-b4e880b7-a2ec-4356-bb27-33b8be52ab45 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed HTTP/1.1" status: 200 len: 217 time: 0.1718166 Dec 14 03:14:58.028362 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-75553d58-e7fe-4b92-9288-f89732c87593 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.063747 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.084374 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.119233 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-75553d58-e7fe-4b92-9288-f89732c87593 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.148862 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 1b9553c4-78d4-462f-a94a-3ea34b003fd3, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1b9553c4-78d4-462f-a94a-3ea34b003fd3,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:58.164365 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.172747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.180960 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Made reservation on behalf of bb4be946dd9b4b2080fb3b398521624e for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:14:58.184798 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.235549 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-75553d58-e7fe-4b92-9288-f89732c87593 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3286a311faa64f1cbb3841e589a72532&name=default HTTP/1.1" status: 200 len: 2996 time: 2.6127124 Dec 14 03:14:58.248150 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48448) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:58.249869 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.259534 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-622a9b01-0486-4704-a51f-a1f2a02555b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:58.261915 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-622a9b01-0486-4704-a51f-a1f2a02555b8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=54fa88c0-5b07-4018-9346-f1d3f6f3df1d HTTP/1.1" status: 200 len: 851 time: 0.2369916 Dec 14 03:14:58.262959 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75553d58-e7fe-4b92-9288-f89732c87593 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92f54ed3-da8f-485c-bbd1-d76baa735643,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.263877 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.345222 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.360282 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f87660e-f107-424e-8253-121fd553bc8b,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.379577 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.396076 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.399941 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-65ea8134-02e2-4cae-a36f-0515edffca34 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6873231 Dec 14 03:14:58.408180 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48456) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:58.423814 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.430321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group_rule': {'security_group_id': '47a97fb2-30c0-4223-91ff-a553b95b2269', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:58.442337 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.536366 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:58.539572 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b75c1ac3-b9d3-4084-a159-8e13a3a78e37 None None] Pushing event updated for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.553683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:58.562659 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:58.569138 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:58.569785 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.573888 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Pushing event updated for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.628813 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-1ba8047c-a6fc-470d-8eef-174f09d93cb9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.2246513 Dec 14 03:14:58.636063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.638370 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Attempting to bind port 72b484c2-b432-4085-96b7-6249ec75de2d on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:14:58.638996 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Attempting to bind port 72b484c2-b432-4085-96b7-6249ec75de2d by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:14:58.639464 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Attempting to bind port 72b484c2-b432-4085-96b7-6249ec75de2d on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:14:58.647749 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:14:58.648268 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Checking segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:14:58.648883 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.649353 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Bound using segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:14:58.651454 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Bound port: 72b484c2-b432-4085-96b7-6249ec75de2d, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:14:58.651953 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.660299 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.724239 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Allocated IP 172.20.0.13 (b4af40aa-6be1-48c2-866d-05aa1bdec9d3/2088257b-adb7-490f-afb9-fe03d7b4ad30/4b8834a4-3f18-49ea-b3a2-4053d903f624) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:58.728705 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.801713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.831089 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] For port 72b484c2-b432-4085-96b7-6249ec75de2d, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:14:58.838225 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] For port 72b484c2-b432-4085-96b7-6249ec75de2d, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=72b484c2-b432-4085-96b7-6249ec75de2d,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:14:58.851322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:58.851707 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf547ac0-c193-4941-97e3-8bb9674054c7 req-76a3e1a8-53e6-43fb-a381-3ccd58daa8fd tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:14:58.853879 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bf547ac0-c193-4941-97e3-8bb9674054c7 req-76a3e1a8-53e6-43fb-a381-3ccd58daa8fd tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.0821426 Dec 14 03:14:58.915630 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bf547ac0-c193-4941-97e3-8bb9674054c7 req-acef97b3-5fa2-47fe-af96-b63ef973a1b3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550952 Dec 14 03:14:58.960762 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Allocated IP 172.27.3.44 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/6d480f1a-494b-4578-ba29-125754b4f142) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:14:58.960854 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b75c1ac3-b9d3-4084-a159-8e13a3a78e37 None None] Pushing event updated for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:58.978372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4827d556-2650-4092-8469-479ae41c5009 req-1b30207c-220f-4ca5-8470-7511453ad3b0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.0477021 Dec 14 03:14:59.024798 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] Provisioning complete for port 72b484c2-b432-4085-96b7-6249ec75de2d triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:59.025412 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.049026 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:14:59.049724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:14:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:59.128001 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.144042 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.163058 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.172770 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.175679 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/92f54ed3-da8f-485c-bbd1-d76baa735643 HTTP/1.1" status: 204 len: 168 time: 0.9246328 Dec 14 03:14:59.284894 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:14:59.295753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.301307 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8890445 Dec 14 03:14:59.302230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48484) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:59.306957 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:59.314727 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4679c62-179b-481a-91bb-41c154e03226 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92f54ed3-da8f-485c-bbd1-d76baa735643,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:59.320594 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662009ef-895e-4478-b758-f76712aaa30c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4db9c8f3-5d98-48db-b13f-939221437516,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:59.353076 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.383210 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.401392 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.416602 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.437355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.499968 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=6d480f1a-494b-4578-ba29-125754b4f142,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:59.530553 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:14:59.533083 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-9d03ab43-bebc-430a-a80a-3ec10a2c5750 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=adc7b7f7-be75-4e68-a215-6654c2c27cac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0448005 Dec 14 03:14:59.537747 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:14:59.541407 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:14:59.553490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Request body: {'port': {'device_id': '4687b559-c95a-4b82-a076-a7468c10ebef', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:14:59.557376 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] For port 72b484c2-b432-4085-96b7-6249ec75de2d, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=72b484c2-b432-4085-96b7-6249ec75de2d,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:14:59.570541 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.628446 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec175fe-af00-4fe7-9bd2-444c22112967 None None] Pushing event updated for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:14:59.647470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:58Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:14:59.671613 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.682139 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80b610f8-ce62-4e21-aae0-5eb68172b639 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:58Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:14:59.703482 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-962ac17c-9628-4c85-ac46-1613d0d33200 None None] Provisioning complete for port 72b484c2-b432-4085-96b7-6249ec75de2d triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:14:59.705202 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-962ac17c-9628-4c85-ac46-1613d0d33200 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.797542 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.812416 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48492) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:14:59.855349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:14:59.960679 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:14:59.967455 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48500) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:00.049259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eda6a19c-b9f3-450f-a2a5-5e252250ed16 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.087560 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:00.114616 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:00.117597 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:00.123906 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:00.124570 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.142344 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.146891 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Pushing event updated for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:00.203397 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-13e835d6-1279-49ba-a865-bd0ca6dd263e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.2954926 Dec 14 03:15:00.288408 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-25521ac1-d585-40ad-b12d-11db777f9d3e service neutron] 10.222.0.20 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4485130 Dec 14 03:15:00.289116 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.423029 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46d7016-e4c3-40e2-ae51-fc11589a0fea req-44f26857-9c80-4c4c-bb3c-de1fc3021687 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:00.430281 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d46d7016-e4c3-40e2-ae51-fc11589a0fea req-44f26857-9c80-4c4c-bb3c-de1fc3021687 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 932 time: 0.3305187 Dec 14 03:15:00.458345 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Allocated IP 172.27.3.234 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/e0d95a0b-26cf-4d82-a318-74e54e3d59bf) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:15:00.460284 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Request body: {'port': {'device_id': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:00.475668 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-128b76a1-08cf-47ea-adbf-beeb5c0f77d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.493497 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1b9553c4-78d4-462f-a94a-3ea34b003fd3 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:00.631211 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:00.632455 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.645947 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-128b76a1-08cf-47ea-adbf-beeb5c0f77d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.686449 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.689834 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-b7e7f326-4a79-42f8-8e3c-ab7d4076ba05 service neutron] 10.222.0.20 "GET /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2464392 Dec 14 03:15:00.815393 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d46d7016-e4c3-40e2-ae51-fc11589a0fea req-4fb588d0-b697-4e69-98b2-ec138d505282 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3425202 Dec 14 03:15:00.816252 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-128b76a1-08cf-47ea-adbf-beeb5c0f77d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.871928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0037086-b3d3-4007-999f-397aa55cadfe req-b5da7fd8-6293-440c-b5d9-86b5a00330d3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:00.873688 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c0037086-b3d3-4007-999f-397aa55cadfe req-b5da7fd8-6293-440c-b5d9-86b5a00330d3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.7898927 Dec 14 03:15:00.875449 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 72b484c2-b432-4085-96b7-6249ec75de2d up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:00.912879 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.950599 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.965496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:00.968102 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 72b484c2-b432-4085-96b7-6249ec75de2d triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:00.968605 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.012565 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128b76a1-08cf-47ea-adbf-beeb5c0f77d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdd96aa8-36f0-4c5e-b261-2b0554852fb7,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.041210 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.078755 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=6d480f1a-494b-4578-ba29-125754b4f142,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.092654 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.103336 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-134766b1-6dca-474e-8028-e5244bc2a92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.3399158 Dec 14 03:15:01.120672 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-128b76a1-08cf-47ea-adbf-beeb5c0f77d6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=65451d8f7a0f4d53ad8165afb84586f2&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2769992 Dec 14 03:15:01.123364 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48538) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:01.164836 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.187558 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.192538 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eda6a19c-b9f3-450f-a2a5-5e252250ed16 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.212741 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.229696 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c0037086-b3d3-4007-999f-397aa55cadfe req-fa4ceb3c-029d-4f43-90f4-158178ef8453 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3388648 Dec 14 03:15:01.269558 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eda6a19c-b9f3-450f-a2a5-5e252250ed16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.282773 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.287321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.287590 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:01.288244 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fdd96aa8-36f0-4c5e-b261-2b0554852fb7 HTTP/1.1" status: 204 len: 168 time: 0.1635678 Dec 14 03:15:01.307995 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f920cd8e-50a2-4139-ae95-19b2dc068eeb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdd96aa8-36f0-4c5e-b261-2b0554852fb7,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.340814 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:01.344129 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:01.375908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9d0f1802-5b85-4dd7-847f-3cdd0b182adf {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:01.389304 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=e0d95a0b-26cf-4d82-a318-74e54e3d59bf,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.394062 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.424032 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda6a19c-b9f3-450f-a2a5-5e252250ed16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=493f111c-140f-4e0d-ac2e-1fa44365f423,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.460357 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-eda6a19c-b9f3-450f-a2a5-5e252250ed16 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=708fffa8a2d749d8be627a480a3a32f1&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4747691 Dec 14 03:15:01.460780 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48558) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:01.519190 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Transition to ACTIVE for port object 9d0f1802-5b85-4dd7-847f-3cdd0b182adf will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:01.540238 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.570438 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.571949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.610511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.645996 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-a174ee88-d0d4-48fc-8182-6611cbd1b92d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--1499886672&fields=id&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 267 time: 0.2224298 Dec 14 03:15:01.752440 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.756536 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.757740 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/493f111c-140f-4e0d-ac2e-1fa44365f423 HTTP/1.1" status: 204 len: 168 time: 0.2959659 Dec 14 03:15:01.772499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82168dd1-5174-4025-8313-1a4de0d2d23e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=493f111c-140f-4e0d-ac2e-1fa44365f423,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.785523 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b8834a4-3f18-49ea-b3a2-4053d903f624 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:01.798713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.816658 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Pushing event updated for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.816801 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Transition to ACTIVE for port object 4b8834a4-3f18-49ea-b3a2-4053d903f624 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:01.825051 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.890750 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:01.930234 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48580) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:01.963852 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Attempting to bind port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:01.964249 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Attempting to bind port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:01.964643 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Attempting to bind port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:01.977589 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Pushing event updated for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:01.994472 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0325f09-9c71-4fe1-bfcb-dc24cc181eb7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.006219 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Attempting to bind port 4b8834a4-3f18-49ea-b3a2-4053d903f624 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:02.007087 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Attempting to bind port 4b8834a4-3f18-49ea-b3a2-4053d903f624 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:02.007696 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Attempting to bind port 4b8834a4-3f18-49ea-b3a2-4053d903f624 on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:02.012991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:02.013468 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Attempting to bind port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:02.013608 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Port 4b8834a4-3f18-49ea-b3a2-4053d903f624 on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:02.014166 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Attempting to bind port 4b8834a4-3f18-49ea-b3a2-4053d903f624 on network b4af40aa-6be1-48c2-866d-05aa1bdec9d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:02.027377 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:02.027722 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Checking segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:02.028107 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Bound using segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:02.028545 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Bound port: 4b8834a4-3f18-49ea-b3a2-4053d903f624, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:02.028902 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.046134 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:02.046474 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Checking segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:02.047075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Bound using segment: {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:02.047553 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Bound port: 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '63d17698-aa5e-4fb8-873f-d90c459e1bf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:02.047910 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.148966 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:15:02.154576 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:15:02.165581 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.204736 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-20a46b6f-9555-4423-bc0b-9f5be0fcfd8f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.206265 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-20a46b6f-9555-4423-bc0b-9f5be0fcfd8f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 817 time: 0.3861110 Dec 14 03:15:02.227869 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f31cd7-d235-4914-aa01-af3f72ec04b3 req-851d7d50-b7ca-496d-bacd-29a413b017a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.229386 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14f31cd7-d235-4914-aa01-af3f72ec04b3 req-851d7d50-b7ca-496d-bacd-29a413b017a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 944 time: 0.2683880 Dec 14 03:15:02.233807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.235080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.237273 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] 10.222.0.20 "PUT /v2.0/ports/4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 200 len: 1094 time: 1.7841361 Dec 14 03:15:02.240768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:02.245309 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3" -d '{"events": [{"name": "network-changed", "server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:02.274197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0596d5-f1c3-4570-bb60-47cfc48841d2 service neutron] Pushing event updated for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:02.285617 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-c413ee8c-aa35-4c7b-80d4-1276268d9e5d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/quotas/da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 375 time: 0.0692785 Dec 14 03:15:02.303407 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:15:02.361074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-c7ffc7b0-1d70-416e-b688-c61d7a3c3083 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.362898 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-c7ffc7b0-1d70-416e-b688-c61d7a3c3083 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1097 time: 0.0541000 Dec 14 03:15:02.378780 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:15:02.383592 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48602) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:02.427453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.437912 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-a2919cf4-b397-4e74-8c6a-ebe69a0acce3 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 200 len: 217 time: 0.0581610 Dec 14 03:15:02.452460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14f31cd7-d235-4914-aa01-af3f72ec04b3 req-c58829cc-714f-4484-af8f-0b9350e895b8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2079222 Dec 14 03:15:02.500259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.500877 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.502295 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] 10.222.0.20 "PUT /v2.0/ports/9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 1093 time: 2.9713340 Dec 14 03:15:02.503467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:02.522049 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-602e7d4c-9caf-4901-b9fe-58af49b485cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.523523 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-602e7d4c-9caf-4901-b9fe-58af49b485cc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0773332 Dec 14 03:15:02.579321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0325f09-9c71-4fe1-bfcb-dc24cc181eb7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.591848 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-57cdddc4-c155-4f8d-907a-fbd165c71e99 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0560517 Dec 14 03:15:02.615894 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-937e9f50-a8ed-403e-8f8c-bdd0ccf21412 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.654122 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0325f09-9c71-4fe1-bfcb-dc24cc181eb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.667146 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-5a7a1682-2b10-4ced-9ea2-ab3bcbc97af8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3601203 Dec 14 03:15:02.684468 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.737917 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.774560 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a1eb197-6e11-43a1-904a-e1148d611e59" -d '{"events": [{"name": "network-changed", "server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:02.775171 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-a2cd050f-8aa4-492f-9699-ddcf18bbb06e service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1739221 Dec 14 03:15:02.786796 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95044e35-1475-4e83-90ee-f6d44fbd4676 service neutron] Pushing event updated for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:02.838915 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0325f09-9c71-4fe1-bfcb-dc24cc181eb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e905074-9edd-4e2d-aad6-69eeb536b9a9,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:02.865549 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.869945 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a0325f09-9c71-4fe1-bfcb-dc24cc181eb7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=77fa1b12905b450f870fbf2ff3b9299b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9213896 Dec 14 03:15:02.874037 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48626) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:02.906521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-dd516231-8b9d-4127-b3cd-8a5b29f9d6fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.908247 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-dd516231-8b9d-4127-b3cd-8a5b29f9d6fe service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1096 time: 0.3332105 Dec 14 03:15:02.909002 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-937e9f50-a8ed-403e-8f8c-bdd0ccf21412 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.926811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-937e9f50-a8ed-403e-8f8c-bdd0ccf21412 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.943847 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d326cf7-e99d-4c55-8c25-45e8df0c500e req-87acfb72-6a30-4057-97ff-b6ad2ccc7683 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:02.945293 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9d326cf7-e99d-4c55-8c25-45e8df0c500e req-87acfb72-6a30-4057-97ff-b6ad2ccc7683 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 943 time: 0.3522010 Dec 14 03:15:02.976503 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:02.982552 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.6790242 Dec 14 03:15:02.984401 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6c9993-56af-46f7-a3a9-af80ae13aa9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=e0d95a0b-26cf-4d82-a318-74e54e3d59bf,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:02.994008 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-937e9f50-a8ed-403e-8f8c-bdd0ccf21412 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=164f0ca19b984eebb1c8f272ac74a98a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6086268 Dec 14 03:15:03.002834 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48632) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:03.025335 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 req-adc4d301-ee02-4f96-9060-79e535e07725 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2427533 Dec 14 03:15:03.029115 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937e9f50-a8ed-403e-8f8c-bdd0ccf21412 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=06deeb28-e7a4-49c8-80be-0c9dff28ba62,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:03.044358 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-ab208906-4641-4211-8a4b-9742397b3886 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.1177609 Dec 14 03:15:03.052139 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.088749 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.114799 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.150713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.160689 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-387a601b-6546-4868-a633-4c39e54253c0 service neutron] 10.222.0.43 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4376702 Dec 14 03:15:03.179257 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9d326cf7-e99d-4c55-8c25-45e8df0c500e req-a673cb72-9278-41af-8df1-c67abc4f2601 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1436751 Dec 14 03:15:03.205689 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.214921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-453e67e5-1891-43de-93ef-0680973e616c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:03.215290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.215372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-453e67e5-1891-43de-93ef-0680973e616c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.1551642 Dec 14 03:15:03.215439 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5e905074-9edd-4e2d-aad6-69eeb536b9a9 HTTP/1.1" status: 204 len: 168 time: 0.3335235 Dec 14 03:15:03.223427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18233c7f-7534-4b21-a682-57ba3d3377ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e905074-9edd-4e2d-aad6-69eeb536b9a9,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:03.258512 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 x-openstack-request-id: req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:03.259292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:03.259292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:03.259513 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624', 'status': 'completed', 'code': 200} Dec 14 03:15:03.267757 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.273290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:03.277785 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/06deeb28-e7a4-49c8-80be-0c9dff28ba62 HTTP/1.1" status: 204 len: 168 time: 0.2736008 Dec 14 03:15:03.287206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8224cbac-0b13-4d05-8d43-acb2de071c70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06deeb28-e7a4-49c8-80be-0c9dff28ba62,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:03.342359 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-96c6f51a-c595-4a6d-bf58-9e3cba031efe service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0470123 Dec 14 03:15:03.400193 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-a6a1a1cb-3b2d-455e-864f-2d0730592534 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:03.401743 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-a6a1a1cb-3b2d-455e-864f-2d0730592534 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1097 time: 0.0953655 Dec 14 03:15:03.484890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-97debf6f-fdbf-4fe6-b441-a075afa792dd service neutron] 10.222.0.43 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3233089 Dec 14 03:15:03.529806 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-fb5fd9ed-1771-4dd9-b42c-c91c842a8d54 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1763067 Dec 14 03:15:03.563857 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-06af9c3e-8b1c-41d3-93ac-ca1c65b7ef81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:03.565442 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-06af9c3e-8b1c-41d3-93ac-ca1c65b7ef81 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1551325 Dec 14 03:15:03.614495 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-b9b5a0bd-9d6f-4099-8364-aeb8800f8783 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 200 len: 217 time: 0.0399036 Dec 14 03:15:03.710928 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adca4b5a-30a6-4150-b9ea-369e9fb13fed req-d362d353-3d14-4a9a-9c7f-3bb2002b1aaa service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1722240 Dec 14 03:15:03.716346 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-46ad0428-7de2-418e-a729-940b4cd26393 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:03.717812 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-46ad0428-7de2-418e-a729-940b4cd26393 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0967202 Dec 14 03:15:03.756192 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ce74b7f-166e-418c-bd93-195aadf00c5b x-openstack-request-id: req-0ce74b7f-166e-418c-bd93-195aadf00c5b {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:03.756482 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:03.756738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0ce74b7f-166e-418c-bd93-195aadf00c5b {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:03.757187 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf', 'status': 'completed', 'code': 200} Dec 14 03:15:03.763981 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9f8a517f-1b7e-4db6-ab49-7f2896db6aed details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:03.798077 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-faa3a943-95b1-4904-80a0-be418a6033ad service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0686345 Dec 14 03:15:03.978104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-abe56c56-5670-4123-a7c9-3cc0f9ad4f69 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--1831167770&fields=id&tenant_id=11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 267 time: 0.1340735 Dec 14 03:15:03.997771 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,segment=NetworkSegment(45d9b456-a3f1-4779-951e-75d07e818a26),segment_id=45d9b456-a3f1-4779-951e-75d07e818a26)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:04.032533 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed', 'network_id': 'adc7b7f7-be75-4e68-a215-6654c2c27cac', 'port_id': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed', 'mac_address': 'fa:16:3e:43:32:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 257, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '54fa88c0-5b07-4018-9346-f1d3f6f3df1d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:04.036877 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-9a8d89e7-5bc7-4601-a515-106fdfeb404f service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1790254 Dec 14 03:15:04.108427 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-06515605-1bca-4465-8a7b-d2fc8aecacf8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:04.117701 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-06515605-1bca-4465-8a7b-d2fc8aecacf8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 810 time: 0.1385770 Dec 14 03:15:04.118467 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.144213 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9f8a517f-1b7e-4db6-ab49-7f2896db6aed {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:04.149040 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-941eed90-13bd-472f-8059-04008482c293 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:04.150866 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-941eed90-13bd-472f-8059-04008482c293 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1096 time: 0.2683480 Dec 14 03:15:04.159194 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-68c50eab-86d3-4f16-a7ac-b82d089dc7bc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/quotas/11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 375 time: 0.0403461 Dec 14 03:15:04.170933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21801618-7ffa-4647-9ed6-3beaa34c05ca req-49f04b7b-2821-4087-9846-0dce21cf37a1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:04.172568 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21801618-7ffa-4647-9ed6-3beaa34c05ca req-49f04b7b-2821-4087-9846-0dce21cf37a1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 944 time: 0.2737303 Dec 14 03:15:04.198537 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,segment=NetworkSegment(45d9b456-a3f1-4779-951e-75d07e818a26),segment_id=45d9b456-a3f1-4779-951e-75d07e818a26)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:04.209476 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.247267 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48688) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:04.266605 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-9b46a196-6cca-4a6f-9df8-1b380a3ded97 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2219696 Dec 14 03:15:04.272318 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:04.275645 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f18062f3-c015-4684-b19a-e753ba9e470c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.379142 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f18062f3-c015-4684-b19a-e753ba9e470c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.390333 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f18062f3-c015-4684-b19a-e753ba9e470c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.461758 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f18062f3-c015-4684-b19a-e753ba9e470c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b5224adb55d5434aa97c0cbffb14693e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2134037 Dec 14 03:15:04.464984 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48696) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:04.504118 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18062f3-c015-4684-b19a-e753ba9e470c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05369e4a-f10b-4d6b-9c39-05598cee7a64,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:04.525445 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.553217 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.619883 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.623081 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:04.624766 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/05369e4a-f10b-4d6b-9c39-05598cee7a64 HTTP/1.1" status: 204 len: 168 time: 0.1584663 Dec 14 03:15:04.635508 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c08464e2-ecda-4e1a-b850-b4ca079c199e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05369e4a-f10b-4d6b-9c39-05598cee7a64,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:04.742117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-103f5fbf-c67a-47af-94a9-ede7efe52166 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5818474 Dec 14 03:15:04.795858 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21801618-7ffa-4647-9ed6-3beaa34c05ca req-6811c1e0-e1d3-4f52-805e-aa2b8a4bd373 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2957144 Dec 14 03:15:04.826357 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9f8a517f-1b7e-4db6-ab49-7f2896db6aed'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:04.845268 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0c65e30c-39e6-4236-bde3-f553b5a4e97f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:04.846413 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0c65e30c-39e6-4236-bde3-f553b5a4e97f service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.6843894 Dec 14 03:15:04.940776 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-da95cb05-1319-45bf-b04c-a4bcc8ec4613 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0811398 Dec 14 03:15:05.030607 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf req-007cefcd-8601-47fb-be9a-19eaf11f4fea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 210 time: 0.0866227 Dec 14 03:15:05.094199 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-c941e2a7-27ee-496d-8d81-89d5aa8862a3 service neutron] 10.222.0.43 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3509123 Dec 14 03:15:05.178222 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-78df3428-68a0-4922-8522-21535cf2ad6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:05.179809 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-78df3428-68a0-4922-8522-21535cf2ad6f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.2244356 Dec 14 03:15:05.247784 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-94f2302e-f8fb-429c-b66e-8e80916eb9b0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0583613 Dec 14 03:15:05.293595 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a768c2-5ce8-41a0-b580-b38d2791f6df req-c99d93c4-7400-48e5-9d27-13606f5adaec tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:05.300723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c4a768c2-5ce8-41a0-b580-b38d2791f6df req-c99d93c4-7400-48e5-9d27-13606f5adaec tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 944 time: 0.1529899 Dec 14 03:15:05.372088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-7e9f1073-ae53-4e48-b4c3-6a1a8d6bfcee service neutron] 10.222.0.43 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2769082 Dec 14 03:15:05.416604 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c4a768c2-5ce8-41a0-b580-b38d2791f6df req-c94b56ce-47a7-4b35-970d-e957cf024c47 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120427 Dec 14 03:15:05.460534 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-f451a5e2-347b-4765-a2d0-6bad6574b468 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1920738 Dec 14 03:15:05.613436 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-26ac2888-4aca-4c11-8c23-46fe3d13a919 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1419404 Dec 14 03:15:05.625630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-a8c97e7f-aee1-4ca4-a229-84c6254dc2db tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:05.630944 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-a8c97e7f-aee1-4ca4-a229-84c6254dc2db tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 817 time: 0.2387509 Dec 14 03:15:05.660992 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48758) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:05.771458 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fac75e47-6cb5-4a7b-a895-a68a215fe88f req-26f795e9-93c2-40df-af95-69c8f0d546bb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 210 time: 0.0574803 Dec 14 03:15:05.779940 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-6e55a5c3-8f29-4d9d-a625-de3b573bc32d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 380 time: 0.1301987 Dec 14 03:15:05.793092 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'port': {'device_id': '86395107-d320-45d8-83de-f1848858be10', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'admin_state_up': True, 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'security_groups': ['64e4245c-c105-4dc8-9d60-e655a160fa8f']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:05.967188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Made reservation on behalf of da53d564588b46b7bd658659f40a6ded for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:05.972532 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07d3b71-a52d-427d-a307-3af3ec18269b req-1a540b5c-5d23-4082-b6cd-ad840275a882 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:05.972899 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:05.975257 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b07d3b71-a52d-427d-a307-3af3ec18269b req-1a540b5c-5d23-4082-b6cd-ad840275a882 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 944 time: 0.0685992 Dec 14 03:15:06.034797 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df719aca-e49a-4c8b-9757-1d38efd76882 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.082922 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b07d3b71-a52d-427d-a307-3af3ec18269b req-2765b859-4913-4e83-af03-aba67891d0ba tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994034 Dec 14 03:15:06.219175 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df719aca-e49a-4c8b-9757-1d38efd76882 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.260776 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Allocated IP 172.20.0.4 (61e8c126-6b7d-4549-9293-90629e6175d3/8711f032-5b57-4823-aa19-b0e6030552b6/85ceb16f-0c27-48e9-ab76-5cd49eb12802) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:15:06.270757 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df719aca-e49a-4c8b-9757-1d38efd76882 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.287491 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e req-413aa602-8cd2-46af-9189-526d93626338 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 210 time: 0.0711045 Dec 14 03:15:06.347815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df719aca-e49a-4c8b-9757-1d38efd76882 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b209be7-e76c-417c-8f85-04c445bd7f07,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:06.352987 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-df719aca-e49a-4c8b-9757-1d38efd76882 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=49233ae3a68f420cba359c8e07508043&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6906271 Dec 14 03:15:06.355626 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48798) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:06.419437 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.469868 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.492174 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.536792 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.593602 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:06.596751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:06.601120 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:06.606785 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:06.607568 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.629799 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.631327 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:06.634351 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.638890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1b209be7-e76c-417c-8f85-04c445bd7f07 HTTP/1.1" status: 204 len: 168 time: 0.2822146 Dec 14 03:15:06.640295 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-692df72c-09b3-4ca8-bba4-c533a6d5bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8532605 Dec 14 03:15:06.658206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Request body: {'port': {'device_id': '86395107-d320-45d8-83de-f1848858be10', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:06.687023 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd93ad8-6f91-4d8c-b593-bae527852789 req-1b7a931e-47d5-46e0-b5e6-6e5dfc960d33 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:06.691015 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2cd93ad8-6f91-4d8c-b593-bae527852789 req-1b7a931e-47d5-46e0-b5e6-6e5dfc960d33 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 944 time: 0.1474514 Dec 14 03:15:06.720296 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfc338eb-f910-4268-858a-2fa20ff89845 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b209be7-e76c-417c-8f85-04c445bd7f07,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:06.779075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:06.840315 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2cd93ad8-6f91-4d8c-b593-bae527852789 req-8c6bccde-3066-4fe2-9cbd-1083a8904c2a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1313329 Dec 14 03:15:06.984253 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8e7fe401-0c8c-4988-8529-2e9702373c53 req-d95f3c2a-0844-4f42-aff5-38afb2fed7f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 210 time: 0.0629721 Dec 14 03:15:07.063665 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-d7728b6b-24c7-4232-bfa9-b5b47f0e7014 None None] Provisioning complete for port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:07.064206 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d7728b6b-24c7-4232-bfa9-b5b47f0e7014 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.108715 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-d7728b6b-24c7-4232-bfa9-b5b47f0e7014 None None] Port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:15:07.252493 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:07.261362 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.278809 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Transition to ACTIVE for port object 85ceb16f-0c27-48e9-ab76-5cd49eb12802 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:07.287725 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.298981 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27135762-9a9a-4d88-a48d-4d5279538384 req-2b9e1d09-5d87-4dc4-9a99-91d8f78e8f4d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:07.301024 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27135762-9a9a-4d88-a48d-4d5279538384 req-2b9e1d09-5d87-4dc4-9a99-91d8f78e8f4d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 944 time: 0.0684457 Dec 14 03:15:07.414809 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Attempting to bind port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:07.415271 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Attempting to bind port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:07.415722 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Attempting to bind port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:07.418578 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:07.432765 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 on network 61e8c126-6b7d-4549-9293-90629e6175d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:07.432765 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Attempting to bind port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:07.438146 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 14, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:07.438566 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Checking segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:07.439686 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Bound using segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:07.440157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Bound port: 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:07.440680 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.550971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:15:07.557381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:15:07.565868 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48854) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:07.568204 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.588839 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27135762-9a9a-4d88-a48d-4d5279538384 req-e1f0b4dc-45bf-4900-be82-411d61175c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2776659 Dec 14 03:15:07.604715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7438e961-0ed1-481f-b05a-34a44a081581 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.619810 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6b4e99-9910-4be9-b38b-ed90df40e779 req-92723da0-17e9-453f-bdc8-0d6af7bbc454 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:07.621548 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e6b4e99-9910-4be9-b38b-ed90df40e779 req-92723da0-17e9-453f-bdc8-0d6af7bbc454 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1886823 Dec 14 03:15:07.629215 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-97b9556d-0f22-48de-a495-3832bbd7c163 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:07.631560 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-97b9556d-0f22-48de-a495-3832bbd7c163 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 810 time: 0.3290884 Dec 14 03:15:07.706434 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e6b4e99-9910-4be9-b38b-ed90df40e779 req-799488c6-7966-4753-9f5a-ca8505309627 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704737 Dec 14 03:15:07.710124 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:07.710799 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:07.712271 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] 10.222.0.20 "PUT /v2.0/ports/85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 1093 time: 1.0586910 Dec 14 03:15:07.713934 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:07.716384 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b850fa77-0c3f-401d-87ac-889d44387396" -d '{"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:07.723156 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9d0f1802-5b85-4dd7-847f-3cdd0b182adf details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:07.730344 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48864) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:07.859590 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c x-openstack-request-id: req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:07.859914 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:07.860112 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:07.860491 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'status': 'completed', 'code': 200} Dec 14 03:15:07.866445 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-16696d79-af66-41b6-8bae-faa3f7753b9a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 380 time: 0.2134643 Dec 14 03:15:07.869913 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1ebc263-dcb6-4ffe-ad61-e1f0f4a5676b service neutron] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:07.877360 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'port': {'device_id': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'admin_state_up': True, 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'security_groups': ['47a97fb2-30c0-4223-91ff-a553b95b2269']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:07.887519 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9f8a517f-1b7e-4db6-ab49-7f2896db6aed up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:07.893257 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48872) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:08.031485 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7438e961-0ed1-481f-b05a-34a44a081581 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.035348 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-e9277e66-e9ad-401a-ad69-2fd7cb7f6fcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:08.037136 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-e9277e66-e9ad-401a-ad69-2fd7cb7f6fcf service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1096 time: 0.2094104 Dec 14 03:15:08.040443 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7438e961-0ed1-481f-b05a-34a44a081581 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.073345 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:08.084067 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7438e961-0ed1-481f-b05a-34a44a081581 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ff787537d2f74d22b0ae8cded764ac3a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5094433 Dec 14 03:15:08.094977 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48878) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:08.100791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'port_id': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf', 'mac_address': 'fa:16:3e:92:cd:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:08.105838 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:08.138974 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:08.139678 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.148393 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-b6c4a6e8-cb33-47f1-8928-c63715c48480 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 217 time: 0.0693338 Dec 14 03:15:08.175103 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.178379 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7438e961-0ed1-481f-b05a-34a44a081581 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86c93ec3-df48-422a-9b96-15dd1772b46f,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:08.199028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9d0f1802-5b85-4dd7-847f-3cdd0b182adf {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:08.214174 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eba6ae9b-2031-4d8a-a61d-cbd92e90da0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.231526 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:08.232766 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-91a8acb9-b80c-46b6-88d6-e684861329c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:08.234222 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-91a8acb9-b80c-46b6-88d6-e684861329c3 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0753319 Dec 14 03:15:08.237962 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-11d116f2-bf08-4662-8bd1-90ca0c6f030c req-3557834b-9205-4e9c-ae39-8067eb17c616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 210 time: 0.1238873 Dec 14 03:15:08.242368 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.252648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-66d942bc-7150-4bf4-85ab-eea91e58ba8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.268184 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.269068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4b8834a4-3f18-49ea-b3a2-4053d903f624 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:08.273850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.328349 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.361026 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:08.369799 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:08.384764 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21b6538-5697-451e-9654-37242ea7d400 req-d6cc6cce-6999-4c62-abf1-4ec900b5b414 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:08.386639 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-d6cc6cce-6999-4c62-abf1-4ec900b5b414 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0865579 Dec 14 03:15:08.392942 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:08.418335 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.421169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.422568 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/86c93ec3-df48-422a-9b96-15dd1772b46f HTTP/1.1" status: 204 len: 168 time: 0.3272932 Dec 14 03:15:08.466194 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '4b8834a4-3f18-49ea-b3a2-4053d903f624', 'network_id': 'b4af40aa-6be1-48c2-866d-05aa1bdec9d3', 'port_id': '4b8834a4-3f18-49ea-b3a2-4053d903f624', 'mac_address': 'fa:16:3e:49:84:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2088257b-adb7-490f-afb9-fe03d7b4ad30', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:08.478746 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,segment=NetworkSegment(45d9b456-a3f1-4779-951e-75d07e818a26),segment_id=45d9b456-a3f1-4779-951e-75d07e818a26)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:08.558031 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.567861 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 req-37d188ec-3810-4796-8cd5-0934c50f81a9 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:08.579337 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 req-37d188ec-3810-4796-8cd5-0934c50f81a9 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 944 time: 0.6365619 Dec 14 03:15:08.642905 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.684463 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b31a118a-e623-42ef-9246-375c878599a3" -d '{"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-plugged", "status": "completed", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:08.698773 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b8834a4-3f18-49ea-b3a2-4053d903f624 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:08.710468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ea921c-3bb3-4601-91ef-71a4ce107789 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86c93ec3-df48-422a-9b96-15dd1772b46f,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:08.724075 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:08.742544 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:08.750784 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.785766 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-8875fd78-cdc9-4c97-8030-823d12e811c7 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3912573 Dec 14 03:15:08.812388 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:08.839753 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 req-b05fb9f5-7550-43c1-baa1-77a0e4856c77 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2582412 Dec 14 03:15:08.885264 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Made reservation on behalf of 11634c00674445cb81d9dabfbcc791a8 for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:08.889051 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.911294 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 req-dc1ff9b7-4758-4c8c-8e3a-b914908aa822 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:08.918384 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 req-dc1ff9b7-4758-4c8c-8e3a-b914908aa822 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 945 time: 0.2260768 Dec 14 03:15:08.962725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eba6ae9b-2031-4d8a-a61d-cbd92e90da0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.964439 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a21b6538-5697-451e-9654-37242ea7d400 req-d557c241-6e57-4e25-a6ea-f7c80e83f1a6 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1668913 Dec 14 03:15:08.982862 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-66d942bc-7150-4bf4-85ab-eea91e58ba8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:08.983848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eba6ae9b-2031-4d8a-a61d-cbd92e90da0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.026739 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-66d942bc-7150-4bf4-85ab-eea91e58ba8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.116644 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f707cdf7-3905-42de-a85d-c354a47839f0 x-openstack-request-id: req-f707cdf7-3905-42de-a85d-c354a47839f0 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:09.117185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-plugged", "status": "completed", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:09.117185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f707cdf7-3905-42de-a85d-c354a47839f0 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:09.117708 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed', 'code': 200} Dec 14 03:15:09.147823 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850fa77-0c3f-401d-87ac-889d44387396 req-e727ae8a-fca4-47a3-9478-29a09fe23a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.149367 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-e727ae8a-fca4-47a3-9478-29a09fe23a69 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1096 time: 0.0723574 Dec 14 03:15:09.182403 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-eba6ae9b-2031-4d8a-a61d-cbd92e90da0a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=34bdb3e9f90b4eb3a1dc5bc599d894e3&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4481370 Dec 14 03:15:09.182403 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba6ae9b-2031-4d8a-a61d-cbd92e90da0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a7cb730-3041-4b1f-bae8-c6132dbaed06,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:09.183478 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48914) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:09.212573 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 req-18b15f21-0539-44fd-9c75-3b3afe7891f0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2932367 Dec 14 03:15:09.251383 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-66d942bc-7150-4bf4-85ab-eea91e58ba8f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=28dd72787d9244a9af4e958909347b5c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3538039 Dec 14 03:15:09.282512 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 48916) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:09.338625 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d942bc-7150-4bf4-85ab-eea91e58ba8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79de58a5-7c57-4127-ad14-3ae6f177a2a2,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:09.364210 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850fa77-0c3f-401d-87ac-889d44387396 req-0a720aa5-60c5-4f1c-9f0d-686c65c8cc47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.365840 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-0a720aa5-60c5-4f1c-9f0d-686c65c8cc47 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.1539299 Dec 14 03:15:09.369535 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.376423 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Allocated IP 172.20.0.7 (7e397d2e-d5ba-40c3-8051-57991a288ab3/cc81a563-179d-4cba-977d-84ceacabb0ec/b1d9bd41-b159-47f7-8b8c-3145159e82db) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:15:09.391564 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ca8da4-69ad-4ddb-8256-d67069642143 req-6e8e258f-9163-42c2-b76e-002e796ca840 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.393333 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6ca8da4-69ad-4ddb-8256-d67069642143 req-6e8e258f-9163-42c2-b76e-002e796ca840 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.2064831 Dec 14 03:15:09.436140 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-3bfad858-0281-44b6-adab-4e0cd6b15353 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 217 time: 0.0473294 Dec 14 03:15:09.448711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.449028 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.469644 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e503658-007a-470e-a8f6-8b70701564a7 req-7500f6cd-092c-40da-aa32-9c46f2dbe75e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 210 time: 0.0487652 Dec 14 03:15:09.493310 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9d0f1802-5b85-4dd7-847f-3cdd0b182adf'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:09.527659 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.537264 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['4b8834a4-3f18-49ea-b3a2-4053d903f624'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:09.594426 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48928) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:09.596805 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6ca8da4-69ad-4ddb-8256-d67069642143 req-eca620ee-f703-40e8-b8df-9044cfb1c50f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1931314 Dec 14 03:15:09.605820 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d5050c7d-8dff-45de-8b47-a684416901f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.607834 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d5050c7d-8dff-45de-8b47-a684416901f2 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.1380999 Dec 14 03:15:09.616224 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-200df0f3-1543-4fc2-a544-54532aa61c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.618681 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-200df0f3-1543-4fc2-a544-54532aa61c0b service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 1098 time: 0.1815460 Dec 14 03:15:09.666074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.677208 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.679829 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.680953 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9a7cb730-3041-4b1f-bae8-c6132dbaed06 HTTP/1.1" status: 204 len: 168 time: 0.4967694 Dec 14 03:15:09.698866 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86acc5de-283a-42c2-8b10-a128293994f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a7cb730-3041-4b1f-bae8-c6132dbaed06,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:09.710166 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850fa77-0c3f-401d-87ac-889d44387396 req-1ea2863f-b43f-47b9-99ab-19eee1045c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:09.711695 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-1ea2863f-b43f-47b9-99ab-19eee1045c1e service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0913804 Dec 14 03:15:09.753685 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.764328 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.765513 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/79de58a5-7c57-4127-ad14-3ae6f177a2a2 HTTP/1.1" status: 204 len: 168 time: 0.4819341 Dec 14 03:15:09.775431 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.798830 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d073b935-f0db-4e78-a661-e0883fb0eb1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79de58a5-7c57-4127-ad14-3ae6f177a2a2,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:09.807349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-966293161-network', 'tenant_id': '1d3ef270d65d474f9150f140a3767576'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:09.870894 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.883060 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Made reservation on behalf of 1d3ef270d65d474f9150f140a3767576 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:09.885443 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.917910 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-148adbf9-d015-4977-beb9-153797529c48 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1975861 Dec 14 03:15:09.921721 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.944909 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.966178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:09.967957 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:10.040393 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:10.043374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:10.047421 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:10.054873 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.055756 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.081206 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 req-067da95a-1b47-44f2-89c6-70044ac1e1ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.084897 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 req-067da95a-1b47-44f2-89c6-70044ac1e1ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.1000240 Dec 14 03:15:10.089306 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ec1b3e8b-5a6a-4eca-8287-1ee75b9ff09f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2161372 Dec 14 03:15:10.093297 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4624894 Dec 14 03:15:10.139934 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-a1cd7184-318f-4256-9fa4-12419a5c9739 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2077951 Dec 14 03:15:10.140796 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=1f1a4cb4-b472-4adf-8e36-8489542758a2,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:10.162758 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 req-6413f729-67ae-4564-9b53-432921288b6a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672786 Dec 14 03:15:10.212192 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.222666 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.251018 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 262} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:15:10.278463 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e83a654e-61a7-4e6e-adfc-e85645ca26f1,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:10.286383 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.286527 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Added segment cb2b094d-9842-4d0e-ad9d-1015fab9cc63 of type vlan for network 6edc1b46-a717-446f-adec-29cbff1b0a1e Dec 14 03:15:10.371595 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.402722 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240f33d4-eec4-4875-b59c-3b87a7e27bdb req-2ffe14f2-19e2-4c3a-ba5c-b5f06377a8a2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.404736 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-240f33d4-eec4-4875-b59c-3b87a7e27bdb req-2ffe14f2-19e2-4c3a-ba5c-b5f06377a8a2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 945 time: 0.0585799 Dec 14 03:15:10.427016 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.428456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.429213 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.499601 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.9038296 Dec 14 03:15:10.502012 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48960) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:10.502579 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48962) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:10.507785 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-240f33d4-eec4-4875-b59c-3b87a7e27bdb req-81bd4b9f-7993-434a-a807-2777f6b82197 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930295 Dec 14 03:15:10.518087 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Request body: {'subnet': {'network_id': '6edc1b46-a717-446f-adec-29cbff1b0a1e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-966293161-subnet', 'tenant_id': '1d3ef270d65d474f9150f140a3767576', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:10.526864 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Request body: {'port': {'device_id': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:10.552680 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-575392f3-e8f2-425a-8f21-b485ade9b362 None None] Provisioning complete for port b1d9bd41-b159-47f7-8b8c-3145159e82db triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:10.553165 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-575392f3-e8f2-425a-8f21-b485ade9b362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.561574 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b52d89b1-ab37-46f2-9340-caf9dc99a38d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.609611 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0746252-2b3c-49c1-beb5-b4c680554f9a admin admin] Pushing event updated for resources: {'Network': ['ID=6edc1b46-a717-446f-adec-29cbff1b0a1e,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:10.624891 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 6edc1b46-a717-446f-adec-29cbff1b0a1e details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:15:10.679223 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Made reservation on behalf of 1d3ef270d65d474f9150f140a3767576 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:10.681848 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.712544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.721423 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-575392f3-e8f2-425a-8f21-b485ade9b362 None None] Port b1d9bd41-b159-47f7-8b8c-3145159e82db cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:15:10.792963 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b52d89b1-ab37-46f2-9340-caf9dc99a38d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.799787 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b52d89b1-ab37-46f2-9340-caf9dc99a38d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.813146 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6ca283a-22a3-475b-a865-4445ffa9571b req-5db95e59-56c9-4570-98a4-353d71ea75c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.815202 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6ca283a-22a3-475b-a865-4445ffa9571b req-5db95e59-56c9-4570-98a4-353d71ea75c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 931 time: 0.1787453 Dec 14 03:15:10.849554 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b52d89b1-ab37-46f2-9340-caf9dc99a38d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6268f75c-c08c-42cb-9f0d-6dbede39bdee,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:10.870191 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486b9d0-080a-41f2-9ddc-098ec3c33796 req-18874cbd-a744-420a-b9c4-c424047313f9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:10.878104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1486b9d0-080a-41f2-9ddc-098ec3c33796 req-18874cbd-a744-420a-b9c4-c424047313f9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1628282 Dec 14 03:15:10.879334 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-b52d89b1-ab37-46f2-9340-caf9dc99a38d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d6d9f7a3ebd14c04906ac8a38ec42975&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3738472 Dec 14 03:15:10.882994 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 48972) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:10.977616 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6ca283a-22a3-475b-a865-4445ffa9571b req-794794e7-7226-420c-9988-fc59cc36f11d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1529052 Dec 14 03:15:10.979306 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:10.982418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.006417 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1486b9d0-080a-41f2-9ddc-098ec3c33796 req-82c1d22b-6800-4b78-a7ed-10fc78358bf6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1275015 Dec 14 03:15:11.068074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.092837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Pushing event updated for resources: {'Subnet': ['ID=57647fe3-dcf9-4fc5-bf88-0f0fd6bf2539,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:11.130828 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Checking segment: {'id': 'cb2b094d-9842-4d0e-ad9d-1015fab9cc63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '6edc1b46-a717-446f-adec-29cbff1b0a1e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:11.131196 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Network hostable DHCP agents. Network: 6edc1b46-a717-446f-adec-29cbff1b0a1e, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:15:11.157304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Network 6edc1b46-a717-446f-adec-29cbff1b0a1e is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:15:11.161265 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.164167 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.167626 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6268f75c-c08c-42cb-9f0d-6dbede39bdee HTTP/1.1" status: 204 len: 168 time: 0.2810342 Dec 14 03:15:11.171519 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1d9bd41-b159-47f7-8b8c-3145159e82db {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:11.173486 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.176502 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 6edc1b46-a717-446f-adec-29cbff1b0a1e) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:11.179697 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cdcae88-c3f7-480b-bbad-1af29a1b8ee5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6268f75c-c08c-42cb-9f0d-6dbede39bdee,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:11.183218 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:11.183965 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.187848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.200249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cd840f2-297e-49f5-9df4-0c510a1ef53e None None] Network 6edc1b46-a717-446f-adec-29cbff1b0a1e requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:11.214888 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6304dafb-5b54-4d58-be70-c25597ae0805 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7020659 Dec 14 03:15:11.216990 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Transition to ACTIVE for port object b1d9bd41-b159-47f7-8b8c-3145159e82db will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:11.222555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.356961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fae47fd-33a5-436d-a265-392ee4310df0 None None] Network 6edc1b46-a717-446f-adec-29cbff1b0a1e requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:11.398802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Pushing event updated for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:11.417810 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ceb6130-80e4-41df-96bc-35e5a81a92df req-9152abf8-017e-435f-b029-b4131ff00a17 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:11.420171 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ceb6130-80e4-41df-96bc-35e5a81a92df req-9152abf8-017e-435f-b029-b4131ff00a17 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.1319604 Dec 14 03:15:11.421021 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Attempting to bind port b1d9bd41-b159-47f7-8b8c-3145159e82db on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:11.421459 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Attempting to bind port b1d9bd41-b159-47f7-8b8c-3145159e82db by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:11.421903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Attempting to bind port b1d9bd41-b159-47f7-8b8c-3145159e82db on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:11.428054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Port b1d9bd41-b159-47f7-8b8c-3145159e82db on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:11.428639 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Attempting to bind port b1d9bd41-b159-47f7-8b8c-3145159e82db on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:11.441192 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:11.441537 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Checking segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:11.442456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Bound using segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:11.442902 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Bound port: b1d9bd41-b159-47f7-8b8c-3145159e82db, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:11.448529 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.553859 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ceb6130-80e4-41df-96bc-35e5a81a92df req-59cb26e5-d902-4cd8-ac7e-06080d9952b7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1267464 Dec 14 03:15:11.578914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:15:11.592719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:15:11.597722 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.647747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:11.648375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:11.649823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] 10.222.0.20 "PUT /v2.0/ports/b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 1093 time: 1.1289220 Dec 14 03:15:11.650223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:11.653234 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4" -d '{"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:11.698566 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf5d6d2-208f-4033-b2ee-87f2c4413729 service neutron] Pushing event updated for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:11.730262 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 x-openstack-request-id: req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:11.730857 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:11.730857 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:11.731232 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'status': 'completed', 'code': 200} Dec 14 03:15:11.780537 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 req-16fb5b46-ad1c-4081-ac28-0d61eaa038b7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:11.782112 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 req-16fb5b46-ad1c-4081-ac28-0d61eaa038b7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 945 time: 0.0692551 Dec 14 03:15:11.823930 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49008) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:11.842524 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 req-52d646ce-2bd0-434c-92b2-8a341147dfb3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513916 Dec 14 03:15:11.975060 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b8e114b-40eb-4c2b-a6bd-037384793ca9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.069433 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b8e114b-40eb-4c2b-a6bd-037384793ca9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.074106 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b8e114b-40eb-4c2b-a6bd-037384793ca9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.109156 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6b8e114b-40eb-4c2b-a6bd-037384793ca9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8ea9e693a4ab44fda25efd775330b000&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2841671 Dec 14 03:15:12.111706 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49028) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:12.137451 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8e114b-40eb-4c2b-a6bd-037384793ca9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=943c9e7f-1967-4007-8e49-c071527ae441,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:12.170426 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca req-7b5c212a-2c96-4433-9bda-e9424392c751 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:12.172055 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca req-7b5c212a-2c96-4433-9bda-e9424392c751 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0884402 Dec 14 03:15:12.196507 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.209505 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c28c5de-00fe-4bc8-99e3-4645d69f33be req-325fe509-0990-4647-baba-49ccfab31c05 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:12.210993 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c28c5de-00fe-4bc8-99e3-4645d69f33be req-325fe509-0990-4647-baba-49ccfab31c05 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0893345 Dec 14 03:15:12.230034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.238057 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49034) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:12.243072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-61062557-network', 'tenant_id': '4e2b5edb1bd448aa8072acfc47c23e9a'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:12.258017 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca req-37f0d736-af62-49c6-bfbf-e1a12f44dc75 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0765107 Dec 14 03:15:12.294366 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Made reservation on behalf of 4e2b5edb1bd448aa8072acfc47c23e9a for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:12.297873 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c28c5de-00fe-4bc8-99e3-4645d69f33be req-d39ed5fd-027f-48e7-8034-19fa672a3633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0788929 Dec 14 03:15:12.297997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.308752 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.319504 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.322477 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.323888 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/943c9e7f-1967-4007-8e49-c071527ae441 HTTP/1.1" status: 204 len: 168 time: 0.2106750 Dec 14 03:15:12.335790 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c656a92d-c145-4679-8469-5cba1e6438de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=943c9e7f-1967-4007-8e49-c071527ae441,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:12.418343 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.423612 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.446323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 264} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:15:12.461092 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8b9d000-6fdc-4f72-95d6-af736f892a3b,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:12.467818 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.468221 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Added segment 3be2ac7e-418d-48bd-b1bd-52d01bc18a84 of type vlan for network 0584c133-5d97-45aa-89f4-78e21f509ac6 Dec 14 03:15:12.525926 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.552546 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.553687 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:12.554338 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.623765 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.3855860 Dec 14 03:15:12.626280 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49054) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:12.633304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Request body: {'subnet': {'network_id': '0584c133-5d97-45aa-89f4-78e21f509ac6', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-61062557-subnet', 'tenant_id': '4e2b5edb1bd448aa8072acfc47c23e9a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:12.644355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83561c86-6bad-4416-a3f7-5d854280b40b admin admin] Pushing event updated for resources: {'Network': ['ID=0584c133-5d97-45aa-89f4-78e21f509ac6,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:12.659503 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 0584c133-5d97-45aa-89f4-78e21f509ac6 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:15:12.677130 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Made reservation on behalf of 4e2b5edb1bd448aa8072acfc47c23e9a for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:12.686263 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Publish callbacks [] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.735013 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 req-647ec4df-b268-4faa-9110-e5626f686286 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:12.747031 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 req-647ec4df-b268-4faa-9110-e5626f686286 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0736489 Dec 14 03:15:12.814272 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 req-53906ddc-28e1-4d85-a687-088bf26aff58 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656683 Dec 14 03:15:12.907809 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:12.969533 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Pushing event updated for resources: {'Subnet': ['ID=fb87ecf4-e76a-4f61-b388-6b2dfcb624db,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:12.984719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 req-aa991910-82de-4478-989a-bba310542f2a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:12.986581 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 req-aa991910-82de-4478-989a-bba310542f2a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 945 time: 0.0588906 Dec 14 03:15:12.993291 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Checking segment: {'id': '3be2ac7e-418d-48bd-b1bd-52d01bc18a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 264, 'network_id': '0584c133-5d97-45aa-89f4-78e21f509ac6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:12.993728 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Network hostable DHCP agents. Network: 0584c133-5d97-45aa-89f4-78e21f509ac6, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:15:13.014695 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Network 0584c133-5d97-45aa-89f4-78e21f509ac6 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:15:13.028157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 0584c133-5d97-45aa-89f4-78e21f509ac6) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:13.032831 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:13.033577 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:13.041141 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e805f89f-48c5-4e3e-a832-951d040ac36c None None] Network 0584c133-5d97-45aa-89f4-78e21f509ac6 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:13.046898 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 req-3ad6d4f9-ec59-4fa2-8a99-9182afbbc851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537150 Dec 14 03:15:13.067858 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-11dd1105-036f-492f-a6e7-9a0f06f4fabe admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4396462 Dec 14 03:15:13.166555 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d310d61e-fa51-42da-b2b5-4944cfb288de None None] Network 0584c133-5d97-45aa-89f4-78e21f509ac6 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:13.439347 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09394824-7279-4472-9f70-972c113cd616 req-bcc6caf5-b629-4f03-a290-0994f92bf8f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:13.440766 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-09394824-7279-4472-9f70-972c113cd616 req-bcc6caf5-b629-4f03-a290-0994f92bf8f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0999417 Dec 14 03:15:13.451971 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede52bfe-6eac-4926-8ab4-8712d1309628 req-b21f99a6-f565-46dc-98c1-f8ffc3bb5e8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:13.453450 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ede52bfe-6eac-4926-8ab4-8712d1309628 req-b21f99a6-f565-46dc-98c1-f8ffc3bb5e8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0691071 Dec 14 03:15:13.521563 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-09394824-7279-4472-9f70-972c113cd616 req-b87e291f-5fb7-403b-bc57-1e0b38817466 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671315 Dec 14 03:15:13.533923 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ede52bfe-6eac-4926-8ab4-8712d1309628 req-422a3653-e0ed-4349-9456-51a5f429d447 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735385 Dec 14 03:15:13.939261 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 req-9833c4fd-b225-41f7-8a43-adf04a6fdedf tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:13.940738 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 req-9833c4fd-b225-41f7-8a43-adf04a6fdedf tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0553627 Dec 14 03:15:13.990466 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 req-4d7bacf8-253a-4b80-9428-85f38e59c405 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437777 Dec 14 03:15:14.180483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc02257-d84e-40ad-ba35-132feb69a851 req-92dc7498-b1c2-405b-aa1c-314cf8f282ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:14.182264 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6fc02257-d84e-40ad-ba35-132feb69a851 req-92dc7498-b1c2-405b-aa1c-314cf8f282ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 945 time: 0.0505085 Dec 14 03:15:14.229638 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6fc02257-d84e-40ad-ba35-132feb69a851 req-17add8df-41fc-48fa-a059-252629868ed2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413833 Dec 14 03:15:14.341415 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9d0f1802-5b85-4dd7-847f-3cdd0b182adf up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:14.397104 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:14.401025 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:14.401404 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.483643 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.507442 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:14.509575 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51818fa1-f47d-4aad-b2e3-a471676c0490" -d '{"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-plugged", "status": "completed", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:14.531443 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:14.536301 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.539971 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4b8834a4-3f18-49ea-b3a2-4053d903f624 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:14.562870 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35d2476e-b365-4390-b054-65ff749352d4 x-openstack-request-id: req-35d2476e-b365-4390-b054-65ff749352d4 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:14.563289 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-plugged", "status": "completed", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:14.563497 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-35d2476e-b365-4390-b054-65ff749352d4 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:14.563930 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf', 'code': 200} Dec 14 03:15:14.645218 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:14.650747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba req-9517def0-050c-457d-9979-dbe0df232eca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:14.652654 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba req-9517def0-050c-457d-9979-dbe0df232eca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0558364 Dec 14 03:15:14.668242 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 4b8834a4-3f18-49ea-b3a2-4053d903f624 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:14.675306 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 4b8834a4-3f18-49ea-b3a2-4053d903f624 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:14.675694 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.740093 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f29c4427-a38c-4b63-a135-6c6c10f0550a req-476fa08c-82f2-4d86-8f62-e9a8b1ae200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:14.741710 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f29c4427-a38c-4b63-a135-6c6c10f0550a req-476fa08c-82f2-4d86-8f62-e9a8b1ae200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0878973 Dec 14 03:15:14.745031 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba req-75ba3697-2718-46cf-a2d3-95d9b2c4d4ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821538 Dec 14 03:15:14.777721 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.808595 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f29c4427-a38c-4b63-a135-6c6c10f0550a req-cd5c957a-1371-4205-af97-fd2940c04690 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606980 Dec 14 03:15:14.824738 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:14.835582 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:14.884916 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:15.103214 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e req-9b23a501-af43-4ab7-bbbd-6206528c6077 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:15.104681 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e req-9b23a501-af43-4ab7-bbbd-6206528c6077 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0478327 Dec 14 03:15:15.153962 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e req-b6b23e68-786e-4227-b8c8-1db8eabfd15a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422657 Dec 14 03:15:15.346768 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16b223e-5dfd-4231-926b-feafea632113 req-ea2b14ab-67d0-41f9-a855-00d670274767 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:15.348398 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a16b223e-5dfd-4231-926b-feafea632113 req-ea2b14ab-67d0-41f9-a855-00d670274767 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0528424 Dec 14 03:15:15.397859 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a16b223e-5dfd-4231-926b-feafea632113 req-02ba9911-637e-4f01-ada4-84d3daedf345 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434964 Dec 14 03:15:15.427954 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49224) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:15.527913 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0a93700d-f6a0-4bbd-b643-16e8843875e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.597312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0a93700d-f6a0-4bbd-b643-16e8843875e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.600667 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0a93700d-f6a0-4bbd-b643-16e8843875e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.637164 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0a93700d-f6a0-4bbd-b643-16e8843875e7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=dd952bb1f88e4bd8b9301cc446f0ed36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2081761 Dec 14 03:15:15.639068 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a93700d-f6a0-4bbd-b643-16e8843875e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff1371db-d1b5-4212-9323-4fc9cdf7c201,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:15.639890 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49228) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:15.687432 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.708093 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.753270 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.755958 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:15.757048 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ff1371db-d1b5-4212-9323-4fc9cdf7c201 HTTP/1.1" status: 204 len: 168 time: 0.1161299 Dec 14 03:15:15.764288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fec079c9-af00-4821-84a7-6d9e98a135b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff1371db-d1b5-4212-9323-4fc9cdf7c201,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:15.876230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f225d8-5759-497c-81bb-b4ffe5054ccf req-854f4f48-4169-4969-8c15-ac06b22df730 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:15.877764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2f225d8-5759-497c-81bb-b4ffe5054ccf req-854f4f48-4169-4969-8c15-ac06b22df730 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0600483 Dec 14 03:15:15.960777 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2f225d8-5759-497c-81bb-b4ffe5054ccf req-971b12dc-1f7a-43ee-b299-38cd0ec8d758 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761769 Dec 14 03:15:15.976074 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96d5a1f-d769-4767-891b-2b84f805ce65 req-015a5a1a-3310-4a70-8d79-a08c9cd7f4ca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:15.977655 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b96d5a1f-d769-4767-891b-2b84f805ce65 req-015a5a1a-3310-4a70-8d79-a08c9cd7f4ca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0747509 Dec 14 03:15:16.057552 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-23127db2-cf28-46ee-bb33-1cb912d384d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:16.059076 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-23127db2-cf28-46ee-bb33-1cb912d384d8 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1096 time: 0.0683408 Dec 14 03:15:16.062332 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b96d5a1f-d769-4767-891b-2b84f805ce65 req-5925c5a4-e5d9-4e68-8cd3-96c56b8e9175 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785494 Dec 14 03:15:16.067888 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49244) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:16.080649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7689c13-7ceb-4e88-8964-9f0ba5f87c7c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.154575 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7689c13-7ceb-4e88-8964-9f0ba5f87c7c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.158050 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7689c13-7ceb-4e88-8964-9f0ba5f87c7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.194818 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-c7689c13-7ceb-4e88-8964-9f0ba5f87c7c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0acab00352f64e5f89f1892b79d094c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1259131 Dec 14 03:15:16.196770 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7689c13-7ceb-4e88-8964-9f0ba5f87c7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=450b7e44-9d26-461b-903a-a58737d98d29,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:16.197594 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49248) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:16.247353 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.268029 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.268417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987a474a-2081-41da-8876-8b8a9895a292 req-7b0ddaae-ae71-4c1f-a1a2-f4ba93eeb81d tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:16.270414 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-987a474a-2081-41da-8876-8b8a9895a292 req-7b0ddaae-ae71-4c1f-a1a2-f4ba93eeb81d tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0476639 Dec 14 03:15:16.320753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.323788 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:16.324920 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/450b7e44-9d26-461b-903a-a58737d98d29 HTTP/1.1" status: 204 len: 168 time: 0.1262696 Dec 14 03:15:16.334615 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182198a8-5fad-451a-8464-e27d1d38df86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=450b7e44-9d26-461b-903a-a58737d98d29,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:16.392656 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-987a474a-2081-41da-8876-8b8a9895a292 req-993eede1-bbed-4178-bf09-98392620da4a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163793 Dec 14 03:15:16.478222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-712d2cc5-0333-4228-8635-533bd0321070 req-572a7c33-fafb-4a83-a0cb-2d0cad7a7025 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:16.480492 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-712d2cc5-0333-4228-8635-533bd0321070 req-572a7c33-fafb-4a83-a0cb-2d0cad7a7025 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0457809 Dec 14 03:15:16.532030 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-712d2cc5-0333-4228-8635-533bd0321070 req-2fabce6f-ad92-4b37-a191-7b93adb81589 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440202 Dec 14 03:15:16.565500 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:16.568850 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36" -d '{"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-plugged", "status": "completed", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:16.606766 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0533ca8f-c4da-4e1a-934f-235c193c8c9f x-openstack-request-id: req-0533ca8f-c4da-4e1a-934f-235c193c8c9f {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:16.607354 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-plugged", "status": "completed", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:16.607765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0533ca8f-c4da-4e1a-934f-235c193c8c9f {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:16.608517 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624', 'code': 200} Dec 14 03:15:16.681859 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-812b6c80-3443-4e3c-bea5-6fb72cca8c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:16.683323 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-812b6c80-3443-4e3c-bea5-6fb72cca8c45 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=11634c00674445cb81d9dabfbcc791a8&shared=False HTTP/1.1" status: 200 len: 911 time: 0.3822970 Dec 14 03:15:16.702345 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 req-09106aa0-7b46-4fb1-8f02-d0e00466330a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:16.703787 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 req-09106aa0-7b46-4fb1-8f02-d0e00466330a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.2306035 Dec 14 03:15:16.755942 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 req-09abbeaa-17c7-4fc7-a9a7-3484adf0d8df tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453451 Dec 14 03:15:17.226046 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0d8092-b989-4a2c-9662-cc6784997356 req-7ecc5af3-a7b4-4cad-a1f3-a3c504028934 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.233237 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b0d8092-b989-4a2c-9662-cc6784997356 req-7ecc5af3-a7b4-4cad-a1f3-a3c504028934 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.2025979 Dec 14 03:15:17.306580 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83998cfc-1df3-4aa3-9b83-8e702c0335c6 req-0646c5b8-9114-4c41-9ff9-e2f1efcb8b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.308149 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-83998cfc-1df3-4aa3-9b83-8e702c0335c6 req-0646c5b8-9114-4c41-9ff9-e2f1efcb8b50 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1099 time: 0.0493283 Dec 14 03:15:17.330925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad req-c58d1215-6e35-434c-9639-73ad9f7e1aa5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.332990 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad req-c58d1215-6e35-434c-9639-73ad9f7e1aa5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1633718 Dec 14 03:15:17.344885 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-103edc1e-9c73-43ba-b590-05384ffe559d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.346500 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-103edc1e-9c73-43ba-b590-05384ffe559d service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2898865 Dec 14 03:15:17.356721 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b0d8092-b989-4a2c-9662-cc6784997356 req-cf3aba9d-931e-4b15-94f9-b86c20eb5763 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1225808 Dec 14 03:15:17.358521 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-83998cfc-1df3-4aa3-9b83-8e702c0335c6 req-238692e6-592a-4e82-b14a-573f7f9b4968 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425067 Dec 14 03:15:17.399161 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad req-04ab739d-91d3-4eb5-9b0f-c809e6df1503 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558310 Dec 14 03:15:17.508289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819d6925-afba-454d-8cbd-cb9100d9f8d7 req-adca0024-a65e-4fbf-a529-77a01c0aa37a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.509770 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-819d6925-afba-454d-8cbd-cb9100d9f8d7 req-adca0024-a65e-4fbf-a529-77a01c0aa37a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0482843 Dec 14 03:15:17.562261 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-819d6925-afba-454d-8cbd-cb9100d9f8d7 req-a9cd9676-00fd-48f4-b41d-8889b8b2e149 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464478 Dec 14 03:15:17.868427 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd19e2eb-76bd-4274-b2d2-803515b8f033 req-06809f3d-2568-4139-9850-f52a99f3e14f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:17.870011 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cd19e2eb-76bd-4274-b2d2-803515b8f033 req-06809f3d-2568-4139-9850-f52a99f3e14f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0490952 Dec 14 03:15:17.920604 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cd19e2eb-76bd-4274-b2d2-803515b8f033 req-c05dc9bd-7e21-4cfc-9473-5d1760fdb280 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446825 Dec 14 03:15:17.921552 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:18.045111 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:18.057520 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:18.146067 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:18.169462 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:18.180840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-734f53a6-7447-4817-9dde-33d062b19834 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.182461 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-734f53a6-7447-4817-9dde-33d062b19834 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1096 time: 0.0971186 Dec 14 03:15:18.198252 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:18.202864 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:18.252450 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-f9b4375f-69d7-4ac4-8c7c-dcc3167a1c5b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 217 time: 0.0485096 Dec 14 03:15:18.267883 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:18.327798 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-f46308e0-5016-4b99-adad-e49082c55afa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.329517 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-f46308e0-5016-4b99-adad-e49082c55afa service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0694106 Dec 14 03:15:18.395587 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-58594ecf-c0e8-4058-9610-9529ef54e95c tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/networks?tenant_id=722b58145d434e1181ebd90e63eb1255&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0742378 Dec 14 03:15:18.433779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-4cf6743c-117e-4a10-bafa-be917e6eede2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.436921 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-4cf6743c-117e-4a10-bafa-be917e6eede2 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0979292 Dec 14 03:15:18.596756 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-e62bd19f-42bc-4b41-939d-3d9bbd8c7522 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470075 Dec 14 03:15:18.635153 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 req-dc178185-7504-4591-ac9a-0255b72ce297 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.636557 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 req-dc178185-7504-4591-ac9a-0255b72ce297 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.1336911 Dec 14 03:15:18.671004 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-17dddd27-7be6-4830-8ba3-585ad60c995e tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.672654 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-17dddd27-7be6-4830-8ba3-585ad60c995e tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2680261 Dec 14 03:15:18.705673 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3337c078-d059-4a4e-a1ee-eccb279f7c8c tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/quotas/722b58145d434e1181ebd90e63eb1255 HTTP/1.1" status: 200 len: 375 time: 0.0256450 Dec 14 03:15:18.710092 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 req-6700a481-b216-443c-908f-18e60ad61ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0635219 Dec 14 03:15:18.729653 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-3c76c02f-7ed1-458e-862f-842b98af8e5d req-ebd44eda-5753-4a3b-bbe6-ec088bbc0eb1 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219273 Dec 14 03:15:18.748978 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-220471ef-1871-4e70-9e75-cb07f04f8bfb tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=722b58145d434e1181ebd90e63eb1255&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0312097 Dec 14 03:15:18.848157 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005f1e71-f427-4de8-8ac8-c631d89ddac2 req-81819526-abf8-4b89-82f9-36e53a2888b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:18.849569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-005f1e71-f427-4de8-8ac8-c631d89ddac2 req-81819526-abf8-4b89-82f9-36e53a2888b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0562646 Dec 14 03:15:18.886329 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['85ceb16f-0c27-48e9-ab76-5cd49eb12802'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:18.925621 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-005f1e71-f427-4de8-8ac8-c631d89ddac2 req-be4ea455-0a8f-4375-a6a4-91a583801a69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0677400 Dec 14 03:15:19.013884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2201b6d-f6e8-443f-b186-607f73ab94da req-984c0d61-4871-40b8-b6cd-2a98d6cbb7cf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 210 time: 0.0501521 Dec 14 03:15:19.063802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dbf97f-333b-4308-91f6-e885afdb59db req-0c01f65d-c54f-4112-be20-36e4e2d16297 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:19.067485 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7dbf97f-333b-4308-91f6-e885afdb59db req-0c01f65d-c54f-4112-be20-36e4e2d16297 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.1021299 Dec 14 03:15:19.197479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7dbf97f-333b-4308-91f6-e885afdb59db req-24bc49e3-a71a-484d-84e8-2818cc3193a2 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1167281 Dec 14 03:15:19.237629 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21464577-15c4-4290-a7a6-af9175bf4685 req-80864b1f-74d7-46e9-a0ab-4e3d53d0924f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:19.239884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21464577-15c4-4290-a7a6-af9175bf4685 req-80864b1f-74d7-46e9-a0ab-4e3d53d0924f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.1038344 Dec 14 03:15:19.303254 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21464577-15c4-4290-a7a6-af9175bf4685 req-436f80ae-d336-43c9-a98c-1060f31f3f0d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547843 Dec 14 03:15:19.483546 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49400) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:19.610170 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ab19445a-5921-497b-977b-d8029330f82a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.645618 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5cb01987-c305-47b5-888c-6aa16ddb68a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.709643 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ab19445a-5921-497b-977b-d8029330f82a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.712805 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ab19445a-5921-497b-977b-d8029330f82a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.768675 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab19445a-5921-497b-977b-d8029330f82a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2450351-5903-44f4-9b60-44978a692af4,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:19.779294 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ab19445a-5921-497b-977b-d8029330f82a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=480af37198ae4cb48aad662630bef045&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2946382 Dec 14 03:15:19.782157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49418) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:19.852574 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.891349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.924716 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561ba540-a25d-4739-b803-4842e9cbf1f8 req-15e6c86a-7ea3-4761-a1dc-d3220d261fd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:19.935785 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-561ba540-a25d-4739-b803-4842e9cbf1f8 req-15e6c86a-7ea3-4761-a1dc-d3220d261fd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0924044 Dec 14 03:15:19.959432 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.962784 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:19.972459 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f2450351-5903-44f4-9b60-44978a692af4 HTTP/1.1" status: 204 len: 168 time: 0.1861324 Dec 14 03:15:19.992321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43102b8f-fa12-419c-9b97-b430fda33a8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2450351-5903-44f4-9b60-44978a692af4,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:20.018870 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-561ba540-a25d-4739-b803-4842e9cbf1f8 req-04d6c8b7-f3b5-44d7-b2d7-f21e43ebbe71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0819213 Dec 14 03:15:20.071748 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49430) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:20.161254 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 req-e414712d-b977-4794-bd8a-fe409dd460a4 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 210 time: 0.0462561 Dec 14 03:15:20.184636 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff65872f-2654-4bba-89a7-0ec8035ce060 req-8df97054-4446-47e4-bde4-aee56d77b914 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:20.184636 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ff65872f-2654-4bba-89a7-0ec8035ce060 req-8df97054-4446-47e4-bde4-aee56d77b914 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.1111989 Dec 14 03:15:20.230469 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ff65872f-2654-4bba-89a7-0ec8035ce060 req-3ec3509c-3887-4402-b31f-ba613b67d05a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445139 Dec 14 03:15:20.353371 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-aea9ee87-873d-4ed4-97f3-47cc10b68564 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.398489 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49440) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:20.432024 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eedebc14-f255-4226-9158-88f5af697340 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.442567 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-aea9ee87-873d-4ed4-97f3-47cc10b68564 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.448307 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-aea9ee87-873d-4ed4-97f3-47cc10b68564 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.472730 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4883d6bc-427a-46ff-8a32-baec1e56117e req-59933326-496b-4ea1-a843-72b319d0fad0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:20.475494 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4883d6bc-427a-46ff-8a32-baec1e56117e req-59933326-496b-4ea1-a843-72b319d0fad0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0867858 Dec 14 03:15:20.486559 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-aea9ee87-873d-4ed4-97f3-47cc10b68564 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8bfddaaf2c8d4e40a54376f425c6f222&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4136136 Dec 14 03:15:20.489512 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49442) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:20.496518 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea9ee87-873d-4ed4-97f3-47cc10b68564 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6fcc808-db65-402d-99ab-8d99ac60cd15,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:20.562438 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4883d6bc-427a-46ff-8a32-baec1e56117e req-e6ac77b4-b0bb-496c-8cfd-3da17c6ad078 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759327 Dec 14 03:15:20.587548 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eedebc14-f255-4226-9158-88f5af697340 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.600224 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eedebc14-f255-4226-9158-88f5af697340 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.616683 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-6eb3caad-ec14-47be-adba-64fcf2a81d9b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.20 "GET /v2.0/networks?tenant_id=722b58145d434e1181ebd90e63eb1255&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0756042 Dec 14 03:15:20.617451 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.656494 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eedebc14-f255-4226-9158-88f5af697340 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6511b1b0-0173-40f9-9086-5de8612fb853,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:20.690428 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-eedebc14-f255-4226-9158-88f5af697340 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fd78635306f94cf8baf0b150f0d5c129&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2875295 Dec 14 03:15:20.690965 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49450) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:20.767307 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.806660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.815297 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.887018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.889654 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:20.891606 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6511b1b0-0173-40f9-9086-5de8612fb853 HTTP/1.1" status: 204 len: 168 time: 0.1971738 Dec 14 03:15:20.912697 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29202caf-b761-4e8f-ada2-78889b145920 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6511b1b0-0173-40f9-9086-5de8612fb853,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:20.995264 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-4ff6c764-33a6-4725-a51d-4b01048a36e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:20.996694 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-4ff6c764-33a6-4725-a51d-4b01048a36e4 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1099 time: 0.0767474 Dec 14 03:15:21.014673 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74ddbea-5107-4c43-9aac-ed676344d293 req-67d8c33c-704a-41f1-978b-451f84401f91 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.016373 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d74ddbea-5107-4c43-9aac-ed676344d293 req-67d8c33c-704a-41f1-978b-451f84401f91 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0866871 Dec 14 03:15:21.126955 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d74ddbea-5107-4c43-9aac-ed676344d293 req-7a4be76d-f15c-4229-a392-1becb081b5b7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030679 Dec 14 03:15:21.179812 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-3163acf0-4186-4bd8-9b12-28fdc9a979aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.181327 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-3163acf0-4186-4bd8-9b12-28fdc9a979aa service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1748173 Dec 14 03:15:21.214303 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-b2f29399-1c4a-4eaf-9c78-32e63af4f44c tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.216373 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-b2f29399-1c4a-4eaf-9c78-32e63af4f44c tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5836868 Dec 14 03:15:21.217367 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.220739 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.226229 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a6fcc808-db65-402d-99ab-8d99ac60cd15 HTTP/1.1" status: 204 len: 168 time: 0.7314484 Dec 14 03:15:21.232501 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d8ac1e-e7e1-4f93-9f69-5be532b997d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6fcc808-db65-402d-99ab-8d99ac60cd15,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:21.254242 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Request body: {'port': {'device_id': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88', 'admin_state_up': True, 'tenant_id': '722b58145d434e1181ebd90e63eb1255'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:21.267695 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-175784e4-1e97-4561-a1e1-5328a56a0f87 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 200 len: 217 time: 0.0534034 Dec 14 03:15:21.373044 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fbde387d-8c10-47a6-bdbe-398687f7b551 req-e36c5b68-be52-40d4-88ce-b1b485655692 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 210 time: 0.0569594 Dec 14 03:15:21.402910 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66336a7-f9f8-4455-aba3-26c6a45b8306 req-f6bc566c-47cb-472f-8502-7e76f7f4145c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.413360 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d66336a7-f9f8-4455-aba3-26c6a45b8306 req-f6bc566c-47cb-472f-8502-7e76f7f4145c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.1330309 Dec 14 03:15:21.431084 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-41a37ea3-c70c-4bd8-80f4-f464440873b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.432327 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-41a37ea3-c70c-4bd8-80f4-f464440873b0 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.1069527 Dec 14 03:15:21.452123 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Made reservation on behalf of 722b58145d434e1181ebd90e63eb1255 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:21.455809 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.471889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.617125 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.626999 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.715620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da239b48-d36b-466f-952b-adf047af168b,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:21.798624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Allocated IP 192.168.233.58 (03fb523b-5e4c-4381-93e1-fe00226b5d88/95c7ceea-6f7b-42ef-aca5-1013b5ca048c/8512939b-7934-497d-9e64-85606ebc8347) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:15:21.819008 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d66336a7-f9f8-4455-aba3-26c6a45b8306 req-2919cb73-c281-4d67-a8b2-3934b90711cb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4036891 Dec 14 03:15:21.844230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-a406fcc7-3d98-45e9-ba95-581bda609b8c service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0522110 Dec 14 03:15:21.876080 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6cefe609-d866-4df0-b2bf-199e89fe522d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.888755 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49502) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:21.913851 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 req-f3d0d936-b561-47d5-b60e-e0dfef31630b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:21.915401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 req-f3d0d936-b561-47d5-b60e-e0dfef31630b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.4385219 Dec 14 03:15:21.918030 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89271061-7959-40da-918d-635d487e2f15 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:21.928736 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:22.002952 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:22.015249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:22.016813 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.021161 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 req-1b6f3e6d-6d3f-48bb-a29a-6e279875d17c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821438 Dec 14 03:15:22.026719 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-697ee977-e607-4e24-a3fd-f1700f7b6e46 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1723053 Dec 14 03:15:22.044409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.101186 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89271061-7959-40da-918d-635d487e2f15 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.109323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89271061-7959-40da-918d-635d487e2f15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.117088 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.136866 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 req-9d2e12cf-7df8-4a2e-9e34-ad84171343e1 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012695 Dec 14 03:15:22.154931 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.196163 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:22.200706 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5351a08a-fe28-41b5-a4fa-7a8c295552ce" -d '{"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:22.201770 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Network 03fb523b-5e4c-4381-93e1-fe00226b5d88 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:22.205629 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:22.207270 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89271061-7959-40da-918d-635d487e2f15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e67fc64a-e4e8-4bb3-9924-00bcf6e387e0,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:22.211288 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-89271061-7959-40da-918d-635d487e2f15 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e51acd9b757d4579ad184fd39ab89232&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3208859 Dec 14 03:15:22.212149 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:22.214180 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49518) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:22.217705 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:22.218343 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.234515 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:22.239135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Pushing event updated for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:22.244682 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.263258 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-3229e16d-9f3c-4bf5-b228-73d0c22d90b3 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.0247350 Dec 14 03:15:22.297715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Request body: {'port': {'device_id': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:22.346715 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b89ac00-c7fa-4267-870b-6235fabd0db6 x-openstack-request-id: req-6b89ac00-c7fa-4267-870b-6235fabd0db6 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:22.347013 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:22.347289 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6b89ac00-c7fa-4267-870b-6235fabd0db6 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:22.347894 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'code': 200} Dec 14 03:15:22.348578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:22.356498 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.393372 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ebbd955-0431-40fc-8380-ffafb06f2958 req-5f8c3046-aca0-4eae-99ba-905b6c6630c8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:22.396988 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.413830 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ebbd955-0431-40fc-8380-ffafb06f2958 req-5f8c3046-aca0-4eae-99ba-905b6c6630c8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.1291120 Dec 14 03:15:22.420864 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.566956 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ebbd955-0431-40fc-8380-ffafb06f2958 req-f5289e1b-520d-440a-b975-1f8e24e2ac7f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520827 Dec 14 03:15:22.589925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c709858c-aa06-47ca-842e-ede0a9090164 req-2a74c4f9-834b-4d68-8e7a-aeec3f6c3591 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:22.592058 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c709858c-aa06-47ca-842e-ede0a9090164 req-2a74c4f9-834b-4d68-8e7a-aeec3f6c3591 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 935 time: 0.1095355 Dec 14 03:15:22.605527 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-24fe7739-9745-4339-9ba6-794b4fad36fa None None] Provisioning complete for port 8512939b-7934-497d-9e64-85606ebc8347 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:22.606228 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-24fe7739-9745-4339-9ba6-794b4fad36fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.625988 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.628521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.629720 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e67fc64a-e4e8-4bb3-9924-00bcf6e387e0 HTTP/1.1" status: 204 len: 168 time: 0.4141829 Dec 14 03:15:22.651235 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-24fe7739-9745-4339-9ba6-794b4fad36fa None None] Port 8512939b-7934-497d-9e64-85606ebc8347 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:15:22.708509 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8b8aef-f5d5-4d0e-a61b-76b69efeebbe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e67fc64a-e4e8-4bb3-9924-00bcf6e387e0,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:22.760256 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c709858c-aa06-47ca-842e-ede0a9090164 req-186a4b04-9ab1-43a7-8b22-52baf137d79d tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1614387 Dec 14 03:15:22.763646 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f447ab0-ff49-43e3-8080-2dbe5f62b2e7 req-c9fa4a02-4d98-47a6-9e2b-a3f575cc9d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:22.765247 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8f447ab0-ff49-43e3-8080-2dbe5f62b2e7 req-c9fa4a02-4d98-47a6-9e2b-a3f575cc9d53 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1098 time: 0.1252754 Dec 14 03:15:22.861981 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8f447ab0-ff49-43e3-8080-2dbe5f62b2e7 req-627bfcfe-f366-4319-b36a-818a578ba9d2 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0749779 Dec 14 03:15:22.879349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8512939b-7934-497d-9e64-85606ebc8347 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:22.888312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.906363 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Transition to ACTIVE for port object 8512939b-7934-497d-9e64-85606ebc8347 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:22.916273 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:22.947821 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 req-b7f3c00c-9041-48e7-a583-05b97f119051 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:22.956452 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 req-b7f3c00c-9041-48e7-a583-05b97f119051 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 943 time: 0.0606856 Dec 14 03:15:22.997615 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Pushing event updated for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:23.012676 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Attempting to bind port 8512939b-7934-497d-9e64-85606ebc8347 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:23.013019 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Attempting to bind port 8512939b-7934-497d-9e64-85606ebc8347 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:23.013760 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Attempting to bind port 8512939b-7934-497d-9e64-85606ebc8347 on network 03fb523b-5e4c-4381-93e1-fe00226b5d88 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:23.027330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Port 8512939b-7934-497d-9e64-85606ebc8347 on network 03fb523b-5e4c-4381-93e1-fe00226b5d88 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:23.029124 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Attempting to bind port 8512939b-7934-497d-9e64-85606ebc8347 on network 03fb523b-5e4c-4381-93e1-fe00226b5d88 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:23.041457 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 15, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:23.041711 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Checking segment: {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:23.042111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Bound using segment: {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:23.042956 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Bound port: 8512939b-7934-497d-9e64-85606ebc8347, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f501cbc-4819-42fe-9d00-1025465763ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 279, 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:23.042956 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:23.072139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 req-588218ca-7b72-43ae-ba8d-7dc7ee6e335c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1140842 Dec 14 03:15:23.237756 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:15:23.241371 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=8512939b-7934-497d-9e64-85606ebc8347,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:15:23.245393 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da62914-409a-426f-ac7e-f5f142c5ba5a req-a307a843-a647-4f2d-b2e4-97c47fd6a838 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.246742 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:23.246871 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7da62914-409a-426f-ac7e-f5f142c5ba5a req-a307a843-a647-4f2d-b2e4-97c47fd6a838 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0815170 Dec 14 03:15:23.295146 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.296045 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:23.297792 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] 10.222.0.20 "PUT /v2.0/ports/8512939b-7934-497d-9e64-85606ebc8347 HTTP/1.1" status: 200 len: 1097 time: 1.0042951 Dec 14 03:15:23.298278 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'tag': '8512939b-7934-497d-9e64-85606ebc8347'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:23.302894 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ede592ee-2100-40eb-9a1c-fa2b5e77272b" -d '{"events": [{"name": "network-changed", "server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:23.344121 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7da62914-409a-426f-ac7e-f5f142c5ba5a req-1bae4d06-3873-42fa-b4b0-5897b4249c62 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0864837 Dec 14 03:15:23.348356 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ed2afd-2fb4-4aed-bd2a-cc8a8d4abfdd service neutron] Pushing event updated for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:23.376151 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 x-openstack-request-id: req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:23.376655 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "tag": "8512939b-7934-497d-9e64-85606ebc8347", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:23.377097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:23.377780 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'tag': '8512939b-7934-497d-9e64-85606ebc8347', 'status': 'completed', 'code': 200} Dec 14 03:15:23.466937 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-d8de5d22-3f8d-435d-8e57-9ea0a623efd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.469287 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-d8de5d22-3f8d-435d-8e57-9ea0a623efd3 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=722b58145d434e1181ebd90e63eb1255&device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 1100 time: 0.0514181 Dec 14 03:15:23.541171 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-5eaa3386-3358-47ae-8f1c-95f11e774a22 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.58&port_id=8512939b-7934-497d-9e64-85606ebc8347 HTTP/1.1" status: 200 len: 217 time: 0.0509021 Dec 14 03:15:23.563238 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:23.604913 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-17bb659e-ec99-413c-8427-c32fd5d377f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.606371 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-17bb659e-ec99-413c-8427-c32fd5d377f7 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=95c7ceea-6f7b-42ef-aca5-1013b5ca048c HTTP/1.1" status: 200 len: 843 time: 0.0543010 Dec 14 03:15:23.675964 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-204bc524-b581-4f26-bc65-6d3ceb2d3285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.678209 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-204bc524-b581-4f26-bc65-6d3ceb2d3285 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=03fb523b-5e4c-4381-93e1-fe00226b5d88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0637078 Dec 14 03:15:23.724683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f278113-9512-4ea5-acc8-0dce3091e2b6 req-98e5dc43-e2a8-447f-9eb8-96d5c5bdea39 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.726404 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9f278113-9512-4ea5-acc8-0dce3091e2b6 req-98e5dc43-e2a8-447f-9eb8-96d5c5bdea39 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0545835 Dec 14 03:15:23.782305 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9f278113-9512-4ea5-acc8-0dce3091e2b6 req-f50d3c0f-bce7-4022-9275-911cc403e359 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498669 Dec 14 03:15:23.795342 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-93a9f441-b24a-42c9-a86b-f823980fd0cb service neutron] 10.222.0.20 "GET /v2.0/networks/03fb523b-5e4c-4381-93e1-fe00226b5d88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1089597 Dec 14 03:15:23.899737 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a req-218cea80-f689-46cf-a742-cbde01320842 service neutron] 10.222.0.20 "GET /v2.0/networks/03fb523b-5e4c-4381-93e1-fe00226b5d88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947385 Dec 14 03:15:23.903802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 req-7878fce7-2daf-4553-81af-3cde9516796b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:23.911459 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 req-7878fce7-2daf-4553-81af-3cde9516796b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 947 time: 0.0715134 Dec 14 03:15:23.940471 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b1d9bd41-b159-47f7-8b8c-3145159e82db details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:23.965995 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 req-856aae4c-c514-4c60-9578-73aa33b28934 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536256 Dec 14 03:15:24.067612 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:24.081094 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'port_id': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'mac_address': 'fa:16:3e:d9:82:db', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 263, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:24.093204 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-6939d3d1-d8ba-4013-894b-5fb23d2f0874 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.094920 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-6939d3d1-d8ba-4013-894b-5fb23d2f0874 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=722b58145d434e1181ebd90e63eb1255&device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 1100 time: 0.0496874 Dec 14 03:15:24.123455 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:24.142377 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b1d9bd41-b159-47f7-8b8c-3145159e82db {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:24.163425 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:24.172733 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:24.233223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a02a414-8b36-4965-b612-e397752be656 req-4194bd43-544c-4a8b-8a7a-71c0ee7089b0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.235724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:24.244006 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a02a414-8b36-4965-b612-e397752be656 req-4194bd43-544c-4a8b-8a7a-71c0ee7089b0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 944 time: 0.0689852 Dec 14 03:15:24.252331 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-d5df27b2-1211-4d3b-b185-bdf06e1764d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.253961 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-d5df27b2-1211-4d3b-b185-bdf06e1764d3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=03fb523b-5e4c-4381-93e1-fe00226b5d88 HTTP/1.1" status: 200 len: 870 time: 0.1458497 Dec 14 03:15:24.323434 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-969dcbaf-4ca1-400a-872e-5c1f42a77593 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.58&port_id=8512939b-7934-497d-9e64-85606ebc8347 HTTP/1.1" status: 200 len: 217 time: 0.0604846 Dec 14 03:15:24.333870 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a02a414-8b36-4965-b612-e397752be656 req-d0729182-99cb-4daa-8632-922bdf84a977 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0877829 Dec 14 03:15:24.429557 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-46735496-92e6-4622-b4e8-ff60b5a52429 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.431068 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-46735496-92e6-4622-b4e8-ff60b5a52429 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=95c7ceea-6f7b-42ef-aca5-1013b5ca048c HTTP/1.1" status: 200 len: 843 time: 0.0912747 Dec 14 03:15:24.553725 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-d1d42f59-e603-4c53-97de-029748d8be53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.555245 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-d1d42f59-e603-4c53-97de-029748d8be53 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=03fb523b-5e4c-4381-93e1-fe00226b5d88&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0879788 Dec 14 03:15:24.566716 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:24.626010 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 req-d2a36066-1ae7-4f32-a8c2-c2c38dd486a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.628593 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 req-d2a36066-1ae7-4f32-a8c2-c2c38dd486a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.1477370 Dec 14 03:15:24.711642 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-f437ea83-8aa5-47af-8774-5c29d31b8e84 service neutron] 10.222.0.20 "GET /v2.0/networks/03fb523b-5e4c-4381-93e1-fe00226b5d88?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1418786 Dec 14 03:15:24.712296 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 req-2a9a1dc6-2b0c-4960-8722-5b2171e511af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727687 Dec 14 03:15:24.829524 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-0b472c6c-d3e9-46a2-beed-22e86b34109a service neutron] 10.222.0.20 "GET /v2.0/networks/03fb523b-5e4c-4381-93e1-fe00226b5d88?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884290 Dec 14 03:15:24.906442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b881d4d9-1cbc-4348-9cf3-f17704e2053a req-bd5a8a9f-4017-4714-9259-cd0d7f498998 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:24.907954 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b881d4d9-1cbc-4348-9cf3-f17704e2053a req-bd5a8a9f-4017-4714-9259-cd0d7f498998 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0514138 Dec 14 03:15:24.955086 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b881d4d9-1cbc-4348-9cf3-f17704e2053a req-97b07753-0dbb-4cd2-90c1-518eb5f1e97f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408752 Dec 14 03:15:25.027185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b1d9bd41-b159-47f7-8b8c-3145159e82db'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:25.078370 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 req-bd1320c5-ce8f-406f-8f75-dfea9eba21fb tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:25.080221 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 req-bd1320c5-ce8f-406f-8f75-dfea9eba21fb tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 947 time: 0.0489776 Dec 14 03:15:25.140320 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 req-df2e9995-c517-41ca-8b9d-6a32128072e9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522726 Dec 14 03:15:25.457773 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b req-5e8f0452-3b25-4ea0-9a6b-6c43f92c8af4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:25.459266 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b req-5e8f0452-3b25-4ea0-9a6b-6c43f92c8af4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 944 time: 0.0470874 Dec 14 03:15:25.506688 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b req-e011cea9-492a-4d25-89bf-667a2e629979 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415828 Dec 14 03:15:25.622492 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49664) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:25.729677 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-11ca1972-fd43-4555-85d6-f8df2c42d6c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:25.780897 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:25.810548 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-11ca1972-fd43-4555-85d6-f8df2c42d6c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:25.821592 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-11ca1972-fd43-4555-85d6-f8df2c42d6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:25.894841 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-11ca1972-fd43-4555-85d6-f8df2c42d6c9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=60afd7ca66854360bb595d54815822f5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2682433 Dec 14 03:15:25.894841 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ca1972-fd43-4555-85d6-f8df2c42d6c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=151111ab-1947-45bc-af1f-502d76f06462,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:25.895685 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49674) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:25.920734 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 req-de30be2f-2dae-4b44-b197-5b189b1bd306 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:25.922273 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 req-de30be2f-2dae-4b44-b197-5b189b1bd306 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.1104312 Dec 14 03:15:25.999331 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 req-b9d8b6fa-5184-46cb-853b-0c190a9cf65c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673556 Dec 14 03:15:26.000100 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.029734 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.127282 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 req-bd5f1e21-7ecd-4a49-bbe5-1b04da3b92f1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:26.128700 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 req-bd5f1e21-7ecd-4a49-bbe5-1b04da3b92f1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0970454 Dec 14 03:15:26.143333 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.146327 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.147375 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/151111ab-1947-45bc-af1f-502d76f06462 HTTP/1.1" status: 204 len: 168 time: 0.2498057 Dec 14 03:15:26.171274 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b req-e8ac130d-d748-4ad0-ac13-d0010c424724 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:26.172715 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b req-e8ac130d-d748-4ad0-ac13-d0010c424724 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0981154 Dec 14 03:15:26.175228 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5f210b0-81e4-499b-a57d-908dbccf142b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=151111ab-1947-45bc-af1f-502d76f06462,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:26.183639 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49688) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:26.196133 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'floatingip': {'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:26.214701 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 req-c490939d-68b5-44fe-9b03-53f264de7cca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789497 Dec 14 03:15:26.298637 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1004f41d-6f56-4288-95cc-6c17567c45fe req-06a1a79e-52a4-44c6-a5c5-e073bff3db61 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:26.300123 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1004f41d-6f56-4288-95cc-6c17567c45fe req-06a1a79e-52a4-44c6-a5c5-e073bff3db61 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 947 time: 0.0511231 Dec 14 03:15:26.300375 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.351156 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1004f41d-6f56-4288-95cc-6c17567c45fe req-a841ffa6-381b-4f62-b41f-938faa58deac tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440736 Dec 14 03:15:26.434568 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49692) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:26.447787 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-424bec12-c85f-458c-a4b8-ba7d4bfbb5a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.524195 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-424bec12-c85f-458c-a4b8-ba7d4bfbb5a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.528767 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-424bec12-c85f-458c-a4b8-ba7d4bfbb5a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.567979 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-424bec12-c85f-458c-a4b8-ba7d4bfbb5a5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8928f0eef8d64150a128cc11a7a7e306&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1320219 Dec 14 03:15:26.568576 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-424bec12-c85f-458c-a4b8-ba7d4bfbb5a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea17848a-667e-4aa5-beb9-0cedb5c60a8a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:26.570956 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49698) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:26.658127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 req-889eac9a-b0cf-427d-a404-7d56a9b25e9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:26.659625 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 req-889eac9a-b0cf-427d-a404-7d56a9b25e9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 944 time: 0.0672202 Dec 14 03:15:26.660521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.704835 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.755294 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 req-01df87fd-fcf6-4745-87ed-d7dd9166c7e7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0847766 Dec 14 03:15:26.779088 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.781863 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:26.783197 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ea17848a-667e-4aa5-beb9-0cedb5c60a8a HTTP/1.1" status: 204 len: 168 time: 0.2113025 Dec 14 03:15:26.792623 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36393f4f-034d-4077-ba53-f0c3bfc4b6e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea17848a-667e-4aa5-beb9-0cedb5c60a8a,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:27.106448 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.db.resource_extend [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] It took 0.28 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 14 03:15:27.187964 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:27.194768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:27.323657 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Floating IP 47c0f7f7-2a66-4b30-b886-e55c11e3c8ab associated. External IP: 172.27.3.44, port: 85ceb16f-0c27-48e9-ab76-5cd49eb12802. Dec 14 03:15:27.388567 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a13ff05f-7aaa-414e-985e-edc78eccb4be req-acf289f2-1cbd-4a1b-89bd-1722ac7b0892 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:27.390336 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a13ff05f-7aaa-414e-985e-edc78eccb4be req-acf289f2-1cbd-4a1b-89bd-1722ac7b0892 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0688727 Dec 14 03:15:27.478542 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a13ff05f-7aaa-414e-985e-edc78eccb4be req-5f550362-2e5e-499b-b2a6-46759777e40c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812359 Dec 14 03:15:27.527507 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7306f4ec-0483-46f3-b081-4de1668a25ce req-a87ec5ac-225b-4533-9f4d-bdb39aca52ad tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:27.529072 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7306f4ec-0483-46f3-b081-4de1668a25ce req-a87ec5ac-225b-4533-9f4d-bdb39aca52ad tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 947 time: 0.0813632 Dec 14 03:15:27.595015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:15:27.629941 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7306f4ec-0483-46f3-b081-4de1668a25ce req-68af6132-493f-49f7-8afa-d4b17121e0ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885577 Dec 14 03:15:27.727822 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:15:27.732665 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:27.741441 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:15:27.751215 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:15:27.751852 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:15:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:27.761457 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7967cdd7-4b4a-4b4f-a8e5-c8c9d90cb9c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "PUT /v2.0/floatingips/47c0f7f7-2a66-4b30-b886-e55c11e3c8ab HTTP/1.1" status: 200 len: 990 time: 1.5734439 Dec 14 03:15:27.762438 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:27.765967 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc5c5725-b020-4ebe-977a-13e54c48c5a2" -d '{"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:27.808783 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-296120f8-fada-4b4e-bd72-3ef9821b8999 x-openstack-request-id: req-296120f8-fada-4b4e-bd72-3ef9821b8999 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:27.809074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:27.809426 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-296120f8-fada-4b4e-bd72-3ef9821b8999 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:27.809829 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'status': 'completed', 'code': 200} Dec 14 03:15:27.884056 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:15:27.930417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4aebaa-a503-424e-85f4-33e8eb65de14 req-0975c06c-bc1b-4371-a7c9-ee5873381df3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:27.939375 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-db4aebaa-a503-424e-85f4-33e8eb65de14 req-0975c06c-bc1b-4371-a7c9-ee5873381df3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 944 time: 0.0730579 Dec 14 03:15:27.954866 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 8512939b-7934-497d-9e64-85606ebc8347 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:15:27.983809 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-8205ac15-414b-49e2-baca-78eff196939f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:27.986664 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b1d9bd41-b159-47f7-8b8c-3145159e82db up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:27.986787 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-8205ac15-414b-49e2-baca-78eff196939f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1098 time: 0.0738964 Dec 14 03:15:28.002169 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-db4aebaa-a503-424e-85f4-33e8eb65de14 req-b258e25c-3abf-4ae7-9c71-5b5e3e623e4f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0610211 Dec 14 03:15:28.103053 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-4c835534-ee23-4adc-8436-ddb9e6cb8390 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.104640 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-4c835534-ee23-4adc-8436-ddb9e6cb8390 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.1071675 Dec 14 03:15:28.159276 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port b1d9bd41-b159-47f7-8b8c-3145159e82db completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:28.168232 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port b1d9bd41-b159-47f7-8b8c-3145159e82db triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:28.168604 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:28.171594 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=8512939b-7934-497d-9e64-85606ebc8347,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:28.208687 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '8512939b-7934-497d-9e64-85606ebc8347', 'network_id': '03fb523b-5e4c-4381-93e1-fe00226b5d88', 'port_id': '8512939b-7934-497d-9e64-85606ebc8347', 'mac_address': 'fa:16:3e:31:13:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 279, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '95c7ceea-6f7b-42ef-aca5-1013b5ca048c', 'ip_address': '192.168.233.58'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:15:28.221990 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '47c0f7f7-2a66-4b30-b886-e55c11e3c8ab', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.44', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 138, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86395107-d320-45d8-83de-f1848858be10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:14:59Z', 'updated_at': '2021-12-14T03:15:26Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:28.231379 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-008d3e93-5174-4e59-8247-f88597daa4b2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 998 time: 0.1171057 Dec 14 03:15:28.256435 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:15:28.259973 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:28.265511 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:15:28.266384 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:15:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:28.296457 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8512939b-7934-497d-9e64-85606ebc8347 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:28.300735 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-5352d409-e584-44a6-878e-4d5ccf249ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.302771 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-5352d409-e584-44a6-878e-4d5ccf249ef9 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0630031 Dec 14 03:15:28.325040 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:28.328144 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=8512939b-7934-497d-9e64-85606ebc8347,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:28.339062 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:28.387504 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:28.389746 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5146e2d6-443f-4dcc-a097-d77fac6f579f" -d '{"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-plugged", "status": "completed", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:28.408406 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:28.423630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-b58f0edf-952a-4c12-9bd8-f0518b32e230 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.428499 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-b58f0edf-952a-4c12-9bd8-f0518b32e230 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1080458 Dec 14 03:15:28.435426 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:15:28.446337 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:28.448648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:28.528919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a x-openstack-request-id: req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:28.529216 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-plugged", "status": "completed", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:28.529476 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:28.529872 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'code': 200} Dec 14 03:15:28.582957 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:28.655612 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e02f785b-d08c-44f5-a999-ae3dc92eb34a req-2d333991-647a-4f8c-b853-fab997a3158d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.663226 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e02f785b-d08c-44f5-a999-ae3dc92eb34a req-2d333991-647a-4f8c-b853-fab997a3158d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0601830 Dec 14 03:15:28.665356 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-e87a0fff-ad2e-42d0-9dbd-a5038cad125e service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2246153 Dec 14 03:15:28.738511 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e02f785b-d08c-44f5-a999-ae3dc92eb34a req-82555394-bd1f-4c97-89b6-529ea09d15ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719652 Dec 14 03:15:28.773701 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-e922f3d6-a376-476c-b603-93736909d83e service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0978713 Dec 14 03:15:28.889157 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '47c0f7f7-2a66-4b30-b886-e55c11e3c8ab', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.44', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 138, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86395107-d320-45d8-83de-f1848858be10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:14:59Z', 'updated_at': '2021-12-14T03:15:26Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:28.903462 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4849f7d-91a4-4379-ad0b-432d0e539b80 req-be165b3e-ce53-42e2-9417-2041238aa212 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.907553 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4849f7d-91a4-4379-ad0b-432d0e539b80 req-be165b3e-ce53-42e2-9417-2041238aa212 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 948 time: 0.1184278 Dec 14 03:15:28.919844 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c061dc3-aea3-4a58-9603-3b426f182fac None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '47c0f7f7-2a66-4b30-b886-e55c11e3c8ab', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.44', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 138, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86395107-d320-45d8-83de-f1848858be10', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:14:59Z', 'updated_at': '2021-12-14T03:15:26Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:15:28.943869 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baaf820c-da6a-4dfb-9def-37a0a84c6da7 req-6f1bf9ad-2f51-4673-adf8-558875227c51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:28.945497 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-baaf820c-da6a-4dfb-9def-37a0a84c6da7 req-6f1bf9ad-2f51-4673-adf8-558875227c51 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.0492940 Dec 14 03:15:28.985997 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['8512939b-7934-497d-9e64-85606ebc8347'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:29.007255 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4849f7d-91a4-4379-ad0b-432d0e539b80 req-bd2dcc32-ae47-4a53-a03d-5df5f185879d tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835774 Dec 14 03:15:29.033911 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-baaf820c-da6a-4dfb-9def-37a0a84c6da7 req-8aa3cd4c-09d4-4ba4-8b20-4f54069840c5 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581164 Dec 14 03:15:29.148047 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f req-b9a0f3e9-2ac0-4fdf-824c-c6c9854f8b75 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:29.150042 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f req-b9a0f3e9-2ac0-4fdf-824c-c6c9854f8b75 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0554659 Dec 14 03:15:29.209058 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f req-cddbfc67-0cbe-4306-becf-0829e639e071 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499003 Dec 14 03:15:29.266707 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b68b877-ebb0-40f7-b802-8c068bfd7fcb None None] New status for floating IP 47c0f7f7-2a66-4b30-b886-e55c11e3c8ab: ACTIVE {{(pid=102573) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:15:29.355707 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49850) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:29.478479 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-03514161-2d5d-40c0-b16c-0e3c5705963e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.566814 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-03514161-2d5d-40c0-b16c-0e3c5705963e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.570618 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-03514161-2d5d-40c0-b16c-0e3c5705963e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.612074 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-03514161-2d5d-40c0-b16c-0e3c5705963e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e7e211fbf56f41c8aff15cac9686aaf9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2519813 Dec 14 03:15:29.612074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03514161-2d5d-40c0-b16c-0e3c5705963e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ce47f2c-c940-4ec2-bd8b-017fb87c99d8,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:29.612540 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49858) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:29.667104 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.687926 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.734916 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.737530 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:29.739234 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6ce47f2c-c940-4ec2-bd8b-017fb87c99d8 HTTP/1.1" status: 204 len: 168 time: 0.1252267 Dec 14 03:15:29.746615 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22c1fa0-9db4-46a8-9134-39eea5257cf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ce47f2c-c940-4ec2-bd8b-017fb87c99d8,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:29.854108 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8669403d-f5d9-4628-b496-a69154eec10b req-84ffe3ca-9cf5-4fa8-8943-e04a531238a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:29.856475 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8669403d-f5d9-4628-b496-a69154eec10b req-84ffe3ca-9cf5-4fa8-8943-e04a531238a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0503764 Dec 14 03:15:29.926569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8669403d-f5d9-4628-b496-a69154eec10b req-def93c37-5d4f-4a40-a73c-4b07bcc325e6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545623 Dec 14 03:15:30.025436 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49872) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:30.038859 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c5ade91c-5834-478e-b3c9-dfe85d929c28 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.117342 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c5ade91c-5834-478e-b3c9-dfe85d929c28 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.118146 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f119539-77a9-4286-8e3a-810aad5414de req-a66b2ea8-64b2-44e5-899f-0455e849a649 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:30.119634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f119539-77a9-4286-8e3a-810aad5414de req-a66b2ea8-64b2-44e5-899f-0455e849a649 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 948 time: 0.0521281 Dec 14 03:15:30.122309 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c5ade91c-5834-478e-b3c9-dfe85d929c28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.165391 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c5ade91c-5834-478e-b3c9-dfe85d929c28 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=159535c867da4520a3145f898c1ebb5c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1390767 Dec 14 03:15:30.166413 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ade91c-5834-478e-b3c9-dfe85d929c28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7399e37c-d7dd-4e05-8750-6e035ea0776a,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:30.168025 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49874) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:30.183018 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f119539-77a9-4286-8e3a-810aad5414de req-961405cc-54f4-4692-abc7-239b5cc07676 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551908 Dec 14 03:15:30.232574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.254383 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.335903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.338464 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:30.339673 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7399e37c-d7dd-4e05-8750-6e035ea0776a HTTP/1.1" status: 204 len: 168 time: 0.1658509 Dec 14 03:15:30.350190 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827101c6-99ee-435e-a685-d9d9d0c77946 req-dc79ccd3-669c-47b0-b02a-666e2dbc64d4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:30.351630 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-827101c6-99ee-435e-a685-d9d9d0c77946 req-dc79ccd3-669c-47b0-b02a-666e2dbc64d4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0758104 Dec 14 03:15:30.356367 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c9bfd4-d32b-4064-aa7f-a34c4cf855c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7399e37c-d7dd-4e05-8750-6e035ea0776a,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:30.400925 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-827101c6-99ee-435e-a685-d9d9d0c77946 req-e3bf2e47-c434-4c06-b52a-04aa0dc53943 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425231 Dec 14 03:15:31.068834 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c7b698-dadd-4fe6-9826-3337844b0caa req-da75aeaf-278d-44f6-80f9-fb953e8457ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:31.070690 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b2c7b698-dadd-4fe6-9826-3337844b0caa req-da75aeaf-278d-44f6-80f9-fb953e8457ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0634203 Dec 14 03:15:31.142016 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b2c7b698-dadd-4fe6-9826-3337844b0caa req-830127ae-ef15-419c-9076-f7c3e20fbdce tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582480 Dec 14 03:15:31.366223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f7ee5d-4b41-48ac-8e62-5e246bd150de req-145f15ec-dd06-4cdc-a3ed-b4240b7b8c84 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:31.367991 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48f7ee5d-4b41-48ac-8e62-5e246bd150de req-145f15ec-dd06-4cdc-a3ed-b4240b7b8c84 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 948 time: 0.0708613 Dec 14 03:15:31.436214 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48f7ee5d-4b41-48ac-8e62-5e246bd150de req-75f80219-790e-41db-b097-f092e82feb6e tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543437 Dec 14 03:15:31.528681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777d8355-a13c-43c7-aa5d-fc440c0e061f req-80bdd5ce-6ad9-49de-8f8b-f8d83d7a8d7a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:31.531283 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-777d8355-a13c-43c7-aa5d-fc440c0e061f req-80bdd5ce-6ad9-49de-8f8b-f8d83d7a8d7a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0553267 Dec 14 03:15:31.608427 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-777d8355-a13c-43c7-aa5d-fc440c0e061f req-b6350af4-646b-450a-ab2f-53b57293d8ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0698979 Dec 14 03:15:31.990791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 8512939b-7934-497d-9e64-85606ebc8347 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:15:32.043310 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 8512939b-7934-497d-9e64-85606ebc8347 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:15:32.047760 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 8512939b-7934-497d-9e64-85606ebc8347 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:15:32.048138 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.136080 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.160601 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8512939b-7934-497d-9e64-85606ebc8347'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:32.163244 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8f3adae-4626-4030-a87e-a70af65d93a8" -d '{"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-plugged", "status": "completed", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:32.178800 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=8512939b-7934-497d-9e64-85606ebc8347,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:32.185438 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.218320 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b1793fb-285a-4eb9-94e3-2f492af2a481 x-openstack-request-id: req-0b1793fb-285a-4eb9-94e3-2f492af2a481 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:32.218625 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-plugged", "status": "completed", "tag": "8512939b-7934-497d-9e64-85606ebc8347", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:32.219068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0b1793fb-285a-4eb9-94e3-2f492af2a481 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:32.219605 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8512939b-7934-497d-9e64-85606ebc8347', 'code': 200} Dec 14 03:15:32.242654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:32.263872 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 49980) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:32.355664 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68620a0-a29b-4205-9573-7e6ee1f7192e req-209a6d5a-0028-4225-b7ce-ccd8d9e3458c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.357174 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d68620a0-a29b-4205-9573-7e6ee1f7192e req-209a6d5a-0028-4225-b7ce-ccd8d9e3458c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0733426 Dec 14 03:15:32.366418 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c928868e-4589-4940-9580-e05d66a40eae req-139cd750-df5f-451b-9675-a01fc3da56ba tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.371516 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c928868e-4589-4940-9580-e05d66a40eae req-139cd750-df5f-451b-9675-a01fc3da56ba tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0990229 Dec 14 03:15:32.373701 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.444645 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d68620a0-a29b-4205-9573-7e6ee1f7192e req-6009a572-f1d7-4424-b627-f4c1dca8d8e7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721304 Dec 14 03:15:32.453916 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.456272 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c928868e-4589-4940-9580-e05d66a40eae req-9d9afc5c-c6f9-458c-b8db-66ec18e209b7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811629 Dec 14 03:15:32.460886 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.496137 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5e1905f3a19645bc9055ba0a47b5b727&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2311072 Dec 14 03:15:32.498840 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 49986) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:32.504965 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f270f797-47cf-4949-bb1d-5370b26a2daa,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:32.513571 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.513933 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.514695 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.515237 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.515737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.516076 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.516416 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.516756 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.517090 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.517421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.517753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.518080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.518408 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5450216a-f3ff-4b5e-8709-56e77c02b314 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.579469 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f req-89209d63-2d1b-46c6-82b8-cf3f8da669e6 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.580933 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f req-89209d63-2d1b-46c6-82b8-cf3f8da669e6 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0681612 Dec 14 03:15:32.583111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f64098b7-324e-4a2f-8dc2-f022e4638208 req-c5d0ff55-b624-44d9-938f-2c21c118db89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.584595 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f64098b7-324e-4a2f-8dc2-f022e4638208 req-c5d0ff55-b624-44d9-938f-2c21c118db89 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 1102 time: 0.0445037 Dec 14 03:15:32.597983 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.636209 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f64098b7-324e-4a2f-8dc2-f022e4638208 req-828c2acd-2b2c-4c5c-9e6f-d3eb1c10f9c3 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414743 Dec 14 03:15:32.640891 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.703456 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f req-e45c8764-b4b9-4a86-b5d7-34580fe746e2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1140828 Dec 14 03:15:32.721624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50000) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:32.754539 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 req-5aab692b-9d51-4f02-ace9-39dc1cebc57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.756166 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 req-5aab692b-9d51-4f02-ace9-39dc1cebc57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0739880 Dec 14 03:15:32.757791 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.760442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.761654 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f270f797-47cf-4949-bb1d-5370b26a2daa HTTP/1.1" status: 204 len: 168 time: 0.2618139 Dec 14 03:15:32.772330 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f270f797-47cf-4949-bb1d-5370b26a2daa,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:32.780148 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Deleting subnet 57647fe3-dcf9-4fc5-bf88-0f0fd6bf2539 {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:15:32.789039 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.789039 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.789280 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.789614 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.789950 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.790413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.790856 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.790966 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.791331 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.792231 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.792736 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.793075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.793402 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.793797 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6e2cea-000c-44ec-bfeb-3c16763b073e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:15:32.833217 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.840990 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 req-05eb5f5a-ec26-4539-8f03-fdb2b18a8b85 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0756156 Dec 14 03:15:32.843811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.906468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.930884 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=57647fe3-dcf9-4fc5-bf88-0f0fd6bf2539,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:32.937026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:32.944638 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-819bf1ba-f9f7-4dfc-983a-1bd78c185bd3 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/57647fe3-dcf9-4fc5-bf88-0f0fd6bf2539 HTTP/1.1" status: 204 len: 168 time: 0.2208636 Dec 14 03:15:32.945421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50010) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:32.977324 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 req-88ae0489-1f29-48db-8575-8e6cb523dc36 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:32.979625 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 req-88ae0489-1f29-48db-8575-8e6cb523dc36 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0626638 Dec 14 03:15:32.987376 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50012) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:32.993480 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'floatingip': {'port_id': 'b1d9bd41-b159-47f7-8b8c-3145159e82db'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:33.017719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.081054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.133020 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.140152 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50014) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:33.162040 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0f507249-ba18-4938-a1e4-c96789e87d81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.167332 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.167682 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.168469 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.168819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > port after_create 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.169140 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.169481 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > port after_update 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.169970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.170349 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.170670 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.170995 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.339968 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.341499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.342042 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.342445 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102572) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:15:33.343295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6edc1b46-a717-446f-adec-29cbff1b0a1e']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:33.376466 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb2b094d-9842-4d0e-ad9d-1015fab9cc63') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:33.376706 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb2b094d-9842-4d0e-ad9d-1015fab9cc63') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:33.400211 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.429139 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.448711 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Releasing vlan 262 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:15:33.449367 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: from cryptography.utils import int_from_bytes Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: from cryptography.utils import int_from_bytes Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:15:33.469522 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:15:33.557252 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.573633 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.576932 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] 10.222.0.43 "DELETE /v2.0/networks/6edc1b46-a717-446f-adec-29cbff1b0a1e HTTP/1.1" status: 204 len: 168 time: 0.6303961 Dec 14 03:15:33.587218 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50022) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:33.589213 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0f507249-ba18-4938-a1e4-c96789e87d81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.598010 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-287a4e51-dff5-4991-bb75-b0081c304c16 admin admin] Pushing event deleted for resources: {'Network': ['ID=6edc1b46-a717-446f-adec-29cbff1b0a1e,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:33.621669 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0f507249-ba18-4938-a1e4-c96789e87d81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.667468 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0f507249-ba18-4938-a1e4-c96789e87d81 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=631f92b195a54780aeeda4055c9a8a78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5262048 Dec 14 03:15:33.670812 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50024) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:33.678626 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f507249-ba18-4938-a1e4-c96789e87d81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62db126c-de75-47aa-a816-2dea5c4b0f97,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:33.692391 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Deleting subnet fb87ecf4-e76a-4f61-b388-6b2dfcb624db {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:15:33.705391 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.768290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.787761 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 req-f9ef09f6-6e0a-4012-a9fd-b6735467cfcf tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:33.789230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 req-f9ef09f6-6e0a-4012-a9fd-b6735467cfcf tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.2228470 Dec 14 03:15:33.797812 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.805314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 req-2d9c1b75-5628-46ed-a39e-0be084023056 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:33.807378 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 req-2d9c1b75-5628-46ed-a39e-0be084023056 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.2528319 Dec 14 03:15:33.844945 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.856491 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.933887 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.936508 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.939943 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/62db126c-de75-47aa-a816-2dea5c4b0f97 HTTP/1.1" status: 204 len: 168 time: 0.2661705 Dec 14 03:15:33.947559 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea4b9e3-b0c4-4f67-a77c-7d0545f36d5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62db126c-de75-47aa-a816-2dea5c4b0f97,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:33.952872 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 req-52fa4618-b458-40fc-b3f7-9edf9343c19e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538811 Dec 14 03:15:33.957564 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:33.998090 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 req-0cb2f089-2962-493e-9211-85d1323b6bb0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1782167 Dec 14 03:15:34.007815 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fb87ecf4-e76a-4f61-b388-6b2dfcb624db,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:34.012499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.017612 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6b3f6101-dcdb-43e2-a519-860fca21b73b admin admin] 10.222.0.43 "DELETE /v2.0/subnets/fb87ecf4-e76a-4f61-b388-6b2dfcb624db HTTP/1.1" status: 204 len: 168 time: 0.4269607 Dec 14 03:15:34.020446 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50032) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:34.104206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.121459 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.130524 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.140240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e6460f-4a93-4b56-a661-94b33e919a6b req-9b5beb25-5767-41a3-9258-a0df64bee73d tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:34.141824 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1e6460f-4a93-4b56-a661-94b33e919a6b req-9b5beb25-5767-41a3-9258-a0df64bee73d tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0903018 Dec 14 03:15:34.194810 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.228055 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0584c133-5d97-45aa-89f4-78e21f509ac6']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:34.244274 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3be2ac7e-418d-48bd-b1bd-52d01bc18a84') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:34.244925 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3be2ac7e-418d-48bd-b1bd-52d01bc18a84') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:34.256091 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.263723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1e6460f-4a93-4b56-a661-94b33e919a6b req-328d6031-0121-4f11-a49a-a5e090d60ed7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915856 Dec 14 03:15:34.272870 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Floating IP d09cc663-920e-4f9d-a375-bf08cb916c05 associated. External IP: 172.27.3.234, port: b1d9bd41-b159-47f7-8b8c-3145159e82db. Dec 14 03:15:34.278252 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.286394 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Releasing vlan 264 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:15:34.286784 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:15:34.288605 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:15:34.349666 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.377014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.383283 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] 10.222.0.43 "DELETE /v2.0/networks/0584c133-5d97-45aa-89f4-78e21f509ac6 HTTP/1.1" status: 204 len: 168 time: 0.3589613 Dec 14 03:15:34.384662 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b08b0c-302c-425b-a1df-850677cfa329 admin admin] Pushing event deleted for resources: {'Network': ['ID=0584c133-5d97-45aa-89f4-78e21f509ac6,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:34.509683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:15:34.528814 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50048) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:34.577976 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3b91d690-b2b6-438d-909e-4535a188a38a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1d3ef270d65d474f9150f140a3767576&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0457377 Dec 14 03:15:34.578188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50050) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:34.627394 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:15:34.628937 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.633855 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.639395 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:15:34.652116 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:15:34.653043 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:15:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:34.653484 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.685401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-993d50bc-4dd1-4fd6-a006-d69b8f0ea47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "PUT /v2.0/floatingips/d09cc663-920e-4f9d-a375-bf08cb916c05 HTTP/1.1" status: 200 len: 991 time: 1.6959109 Dec 14 03:15:34.685731 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:34.689115 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1ca2212-fb0f-4304-bfcc-272ad5566f21" -d '{"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:34.703249 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.706142 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:34.709929 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e83a654e-61a7-4e6e-adfc-e85645ca26f1 HTTP/1.1" status: 204 len: 168 time: 0.1286433 Dec 14 03:15:34.720493 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcc5a05-1ddd-4c2c-83be-48f499cb2bdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e83a654e-61a7-4e6e-adfc-e85645ca26f1,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:34.771397 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 x-openstack-request-id: req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:34.771397 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:34.771397 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:34.771397 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'status': 'completed', 'code': 200} Dec 14 03:15:34.838275 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:15:34.981271 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-ee803c7c-9283-4275-9b0e-e4df4e222f01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:34.982960 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-ee803c7c-9283-4275-9b0e-e4df4e222f01 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.0554259 Dec 14 03:15:35.129832 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-5277301e-eeaa-4b19-a083-b288c53d52c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.130493 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'd09cc663-920e-4f9d-a375-bf08cb916c05', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.234', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:d9:82:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:15:01Z', 'updated_at': '2021-12-14T03:15:33Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:35.132933 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-5277301e-eeaa-4b19-a083-b288c53d52c8 service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.1194453 Dec 14 03:15:35.138111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50074) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:35.168058 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 req-8329ab82-deac-47d7-a7d3-1fbf50ab2d6b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.181682 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 req-8329ab82-deac-47d7-a7d3-1fbf50ab2d6b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.1279433 Dec 14 03:15:35.236880 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7ab0de9c-eb75-4912-9741-80d112746674 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=4e2b5edb1bd448aa8072acfc47c23e9a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0971756 Dec 14 03:15:35.240659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50078) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:35.265916 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:15:35.275829 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:15:35.276564 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:15:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:35.296985 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 req-98b186e4-392b-4736-9aa2-8c4ac57976d4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137006 Dec 14 03:15:35.298508 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-352e32ba-d494-4070-a26b-147f7547cce2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 999 time: 0.1448865 Dec 14 03:15:35.309831 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b11655f-9862-409b-83d0-4e4f561dd6f8 req-ca17b424-78af-4681-ba26-c9819d4d9720 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.321167 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8b11655f-9862-409b-83d0-4e4f561dd6f8 req-ca17b424-78af-4681-ba26-c9819d4d9720 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.1248944 Dec 14 03:15:35.331674 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:35.372674 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8b11655f-9862-409b-83d0-4e4f561dd6f8 req-cd8c1246-a866-4e3b-9a14-967f9bb12b15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527749 Dec 14 03:15:35.391572 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:35.405010 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-29e97928-b88c-4bc4-bdb6-3fd57d1746c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.406151 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-29e97928-b88c-4bc4-bdb6-3fd57d1746c4 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0952041 Dec 14 03:15:35.414257 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:15:35.474448 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-32acea27-b7a3-4a85-9d25-51c0cfaf86ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.476913 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-32acea27-b7a3-4a85-9d25-51c0cfaf86ce service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0515313 Dec 14 03:15:35.488823 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:35.496202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:35.497563 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d8b9d000-6fdc-4f72-95d6-af736f892a3b HTTP/1.1" status: 204 len: 168 time: 0.2556241 Dec 14 03:15:35.507170 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b290a3-924c-410b-9546-5067ed103eac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8b9d000-6fdc-4f72-95d6-af736f892a3b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:35.735615 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf82bec-5cf6-4eff-a2a9-555812335afa req-98e228d0-d0a5-497d-bc05-6865adf927b6 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:35.737326 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adf82bec-5cf6-4eff-a2a9-555812335afa req-98e228d0-d0a5-497d-bc05-6865adf927b6 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.3234251 Dec 14 03:15:35.740715 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-853445e5-05d5-44a7-aba8-56fcd17b5658 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1961045 Dec 14 03:15:35.789703 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'd09cc663-920e-4f9d-a375-bf08cb916c05', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.234', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:d9:82:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:15:01Z', 'updated_at': '2021-12-14T03:15:33Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:35.814410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-adf82bec-5cf6-4eff-a2a9-555812335afa req-1e464103-c5a3-47dc-8442-aaf641f3991b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618501 Dec 14 03:15:35.864907 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1797731-3ba9-47d2-9383-2660f55b0743 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'd09cc663-920e-4f9d-a375-bf08cb916c05', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.234', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:d9:82:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:15:01Z', 'updated_at': '2021-12-14T03:15:33Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:15:35.887916 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-72083059-1dda-4251-9944-30721b32fc45 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357038 Dec 14 03:15:36.200334 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-407598d6-2946-4d54-8e4e-f47aa3bf1aec None None] New status for floating IP d09cc663-920e-4f9d-a375-bf08cb916c05: ACTIVE {{(pid=102573) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:15:36.207099 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83129e36-5d63-4dcc-95d1-726e176861f9 req-917ee359-72b6-43a4-b188-149e7742e6a7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:36.222357 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-83129e36-5d63-4dcc-95d1-726e176861f9 req-917ee359-72b6-43a4-b188-149e7742e6a7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0735393 Dec 14 03:15:36.298214 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-83129e36-5d63-4dcc-95d1-726e176861f9 req-653e45e1-cc4c-4cd3-b45a-816d243fd0d2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651841 Dec 14 03:15:36.508733 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f req-09057bee-bb81-4b60-91b1-22c30b285669 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:36.518179 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f req-09057bee-bb81-4b60-91b1-22c30b285669 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.0843234 Dec 14 03:15:36.587598 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-5aafc7c2-46b3-43a7-845c-5e821562b215 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:36.595602 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-5aafc7c2-46b3-43a7-845c-5e821562b215 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.20 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 945 time: 0.2034538 Dec 14 03:15:36.695650 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f req-dd03655c-932f-411e-9142-d8c3a11508bf tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/security-groups?id=344c1b72-e136-4965-9073-719e9454c82f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1756735 Dec 14 03:15:36.721516 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611e0e50-e542-403a-a398-52fbef04c719 req-37cc0b85-ce63-42d5-bd33-2dca9f29d40e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:36.723671 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-611e0e50-e542-403a-a398-52fbef04c719 req-37cc0b85-ce63-42d5-bd33-2dca9f29d40e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.1976020 Dec 14 03:15:36.787911 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-611e0e50-e542-403a-a398-52fbef04c719 req-8af0aa17-b719-4ccf-8337-fd3b542fef32 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570202 Dec 14 03:15:36.864235 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Deleting port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:15:36.864570 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:36.966416 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:15:37.189864 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] For port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,segment=NetworkSegment(45d9b456-a3f1-4779-951e-75d07e818a26),segment_id=45d9b456-a3f1-4779-951e-75d07e818a26)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:37.190230 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.207069 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling delete_port for 9f8a517f-1b7e-4db6-ab49-7f2896db6aed owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:15:37.361629 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50182) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:37.369092 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50186) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:37.393496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.438355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Pushing event deleted for resources: {'Port': ['ID=9f8a517f-1b7e-4db6-ab49-7f2896db6aed,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:37.451853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 req-e45aa2de-7c4f-4102-9cc4-42e3dbeae3d4 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:37.454079 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 req-e45aa2de-7c4f-4102-9cc4-42e3dbeae3d4 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0719678 Dec 14 03:15:37.462766 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9f8a517f-1b7e-4db6-ab49-7f2896db6aed'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:37.501703 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] No DVR routers for this DVR port 9f8a517f-1b7e-4db6-ab49-7f2896db6aed on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:15:37.504905 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.508391 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea req-b3a5ee22-a024-4d25-b782-4ea07dfe794e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.20 "DELETE /v2.0/ports/9f8a517f-1b7e-4db6-ab49-7f2896db6aed HTTP/1.1" status: 204 len: 173 time: 0.9046156 Dec 14 03:15:37.508840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'name': 'network-vif-deleted', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:37.509043 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f1684d2-7a20-468e-a27e-719b5399b060 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.511277 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc7e55a5-d713-465f-b8df-d584341c67ae" -d '{"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-deleted", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:37.564442 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 req-4c39371b-f9fe-4eff-acb4-6bcad7ba8c59 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953295 Dec 14 03:15:37.564816 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 x-openstack-request-id: req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:37.565112 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-deleted", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:37.565369 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:37.565799 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9988bfe-afac-40fa-ad73-2db57dadf545', 'name': 'network-vif-deleted', 'tag': '9f8a517f-1b7e-4db6-ab49-7f2896db6aed', 'status': 'completed', 'code': 200} Dec 14 03:15:37.566866 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3143ae55-dabf-4dd8-9c84-0db05e1cc1ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.667395 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f1684d2-7a20-468e-a27e-719b5399b060 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.674435 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f1684d2-7a20-468e-a27e-719b5399b060 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.728784 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3143ae55-dabf-4dd8-9c84-0db05e1cc1ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.732201 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-1f1684d2-7a20-468e-a27e-719b5399b060 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=870dd23de886482b9f866c10509d8a8e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3693202 Dec 14 03:15:37.733318 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f1684d2-7a20-468e-a27e-719b5399b060 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92e4d43a-a942-4023-b118-3d5aadaaba6a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:37.735181 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50194) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:37.735903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3143ae55-dabf-4dd8-9c84-0db05e1cc1ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.784209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.798190 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a374b832-006f-4898-a3fe-e647d9ad0290 req-8fbef658-23c7-494f-8d4f-3bd8f5d2205d tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.0452299 Dec 14 03:15:37.804176 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3143ae55-dabf-4dd8-9c84-0db05e1cc1ea admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a2309262b1ae46edbda8fdfef79bf5e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4316661 Dec 14 03:15:37.804176 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3143ae55-dabf-4dd8-9c84-0db05e1cc1ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a73d3eb-fa94-47d7-99ac-be10e40105d0,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:37.804569 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50196) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:37.814997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.886185 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.921719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.924329 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.925464 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/92e4d43a-a942-4023-b118-3d5aadaaba6a HTTP/1.1" status: 204 len: 168 time: 0.1892943 Dec 14 03:15:37.926857 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2869b0-1260-48c4-99e5-517f749a8ef5 req-f5b07ec5-91ef-47d2-8e6d-72f4080d330d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:37.928523 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3a2869b0-1260-48c4-99e5-517f749a8ef5 req-f5b07ec5-91ef-47d2-8e6d-72f4080d330d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0631928 Dec 14 03:15:37.931586 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:37.945100 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57aca9dc-6b1b-451f-bcbe-ddad228067e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92e4d43a-a942-4023-b118-3d5aadaaba6a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:38.000345 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.003494 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.004920 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3a73d3eb-fa94-47d7-99ac-be10e40105d0 HTTP/1.1" status: 204 len: 168 time: 0.1994245 Dec 14 03:15:38.013207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efce3cc8-9b6b-4822-90c0-d5c6d4f8c534 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a73d3eb-fa94-47d7-99ac-be10e40105d0,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:38.014223 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3a2869b0-1260-48c4-99e5-517f749a8ef5 req-4cf16e29-f21b-4456-9f95-b14f737b8c56 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784626 Dec 14 03:15:38.395922 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50220) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:38.408808 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3f08a37b-ee42-475e-bd2a-5cafeb1d986a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.490872 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3f08a37b-ee42-475e-bd2a-5cafeb1d986a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.496683 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3f08a37b-ee42-475e-bd2a-5cafeb1d986a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.540590 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3f08a37b-ee42-475e-bd2a-5cafeb1d986a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1546fe48c3c64835824315b81370f18b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1433556 Dec 14 03:15:38.541711 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f08a37b-ee42-475e-bd2a-5cafeb1d986a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf758a90-0143-487e-a690-6b67f3d012a4,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:38.543261 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50224) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:38.594136 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.618184 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.716762 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda3443c-3a09-4905-9474-1242acf06ed2 req-e1f743bd-6ac6-42e5-addc-43e6fce2a0a9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:38.718410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cda3443c-3a09-4905-9474-1242acf06ed2 req-e1f743bd-6ac6-42e5-addc-43e6fce2a0a9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0718927 Dec 14 03:15:38.740810 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.743501 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:38.744744 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cf758a90-0143-487e-a690-6b67f3d012a4 HTTP/1.1" status: 204 len: 168 time: 0.2003045 Dec 14 03:15:38.766477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92eafd1e-aba2-40c2-bd45-43c0d2f41c33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf758a90-0143-487e-a690-6b67f3d012a4,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:38.791299 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cda3443c-3a09-4905-9474-1242acf06ed2 req-94a008da-4714-4752-ab07-57823697f54f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/security-groups?id=da239b48-d36b-466f-952b-adf047af168b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662308 Dec 14 03:15:38.914997 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-74995e25-d63a-4601-8fab-93c84fdb9806 req-e597eada-dc7b-4a35-91be-8c951b5f84eb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.0279739 Dec 14 03:15:39.153813 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad req-7b0a6d96-7ba3-4c14-8c68-06776886087d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:39.155442 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad req-7b0a6d96-7ba3-4c14-8c68-06776886087d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0531392 Dec 14 03:15:39.218176 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad req-345390d4-8f6e-47c0-b92a-a9bef2a2b5c5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541625 Dec 14 03:15:39.298879 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-316d91a3-6055-4296-ad8f-3f17ec9277f1 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:39.301002 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-316d91a3-6055-4296-ad8f-3f17ec9277f1 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.20 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 949 time: 0.0519841 Dec 14 03:15:39.425657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Deleting port 8512939b-7934-497d-9e64-85606ebc8347 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:15:39.426273 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:39.597317 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] For port 8512939b-7934-497d-9e64-85606ebc8347, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=8512939b-7934-497d-9e64-85606ebc8347,segment=NetworkSegment(6f501cbc-4819-42fe-9d00-1025465763ca),segment_id=6f501cbc-4819-42fe-9d00-1025465763ca)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:15:39.597317 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:39.609953 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling delete_port for 8512939b-7934-497d-9e64-85606ebc8347 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:15:39.768591 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:39.796529 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Pushing event deleted for resources: {'Port': ['ID=8512939b-7934-497d-9e64-85606ebc8347,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:39.815225 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['8512939b-7934-497d-9e64-85606ebc8347'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:15:39.872755 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-4e03b4af-7463-423d-bc2c-bfa717f1d766 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=d9988bfe-afac-40fa-ad73-2db57dadf545&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0792282 Dec 14 03:15:39.878582 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] No DVR routers for this DVR port 8512939b-7934-497d-9e64-85606ebc8347 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:15:39.881382 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:39.884934 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-220ec047-edf8-4e60-80d0-1f1c49365bfd req-cce859a2-03cc-467a-9656-a682bc03b363 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.20 "DELETE /v2.0/ports/8512939b-7934-497d-9e64-85606ebc8347 HTTP/1.1" status: 204 len: 173 time: 0.5628061 Dec 14 03:15:39.885401 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'name': 'network-vif-deleted', 'tag': '8512939b-7934-497d-9e64-85606ebc8347'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:15:39.887839 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0c1c0048-3f73-47da-8919-7c0201cd4833" -d '{"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-deleted", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:15:39.955016 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:15:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 x-openstack-request-id: req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:15:39.955303 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-deleted", "tag": "8512939b-7934-497d-9e64-85606ebc8347", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:15:39.955535 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:15:39.955937 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d', 'name': 'network-vif-deleted', 'tag': '8512939b-7934-497d-9e64-85606ebc8347', 'status': 'completed', 'code': 200} Dec 14 03:15:40.002276 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea req-aaffb9d8-4a0f-4ae5-8f96-0acb093d0bb4 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /v2.0/ports?device_id=ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d HTTP/1.1" status: 200 len: 210 time: 0.0405293 Dec 14 03:15:40.012148 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9f8a517f-1b7e-4db6-ab49-7f2896db6aed no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:15:40.061321 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 9f8a517f-1b7e-4db6-ab49-7f2896db6aed {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:15:40.061679 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9f8a517f-1b7e-4db6-ab49-7f2896db6aed not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:15:40.070326 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-ab03ad5f-fd0b-4534-b285-5544f864391e service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7efcbf12d6654bc68690363892415b77&device_id=d9988bfe-afac-40fa-ad73-2db57dadf545 HTTP/1.1" status: 200 len: 210 time: 0.0706444 Dec 14 03:15:40.366520 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-262c028d-6d63-4716-94bc-4b5e8c975896 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:40.368121 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-262c028d-6d63-4716-94bc-4b5e8c975896 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=7efcbf12d6654bc68690363892415b77&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2465453 Dec 14 03:15:40.493887 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 req-5aeae9f7-30f4-4819-9358-0be629f224da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:40.495418 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 req-5aeae9f7-30f4-4819-9358-0be629f224da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0546527 Dec 14 03:15:40.549450 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 req-1e679bf0-b6b9-485e-9418-8bf24911b630 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478985 Dec 14 03:15:40.549672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-506b312e-8183-4158-b3fa-9a4661aff0a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:40.551000 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-78728d7d-57fb-4506-8873-93481a89c3f5 req-506b312e-8183-4158-b3fa-9a4661aff0a2 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1743317 Dec 14 03:15:41.149175 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.566097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50380) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:41.609177 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Deleting subnet 54fa88c0-5b07-4018-9346-f1d3f6f3df1d {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:15:41.612405 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.653462 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.678456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae req-fc2e0e26-27d5-4b5f-8f9e-6278066adf75 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:41.680158 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae req-fc2e0e26-27d5-4b5f-8f9e-6278066adf75 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0532296 Dec 14 03:15:41.696813 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.733146 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae req-5a0f91cd-239c-4d91-a70c-548e9b49dab8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467088 Dec 14 03:15:41.761950 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.786172 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=54fa88c0-5b07-4018-9346-f1d3f6f3df1d,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:41.791181 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.794312 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-14ee01f5-e8f2-4ff4-b45a-f488f4e5696d admin admin] 10.222.0.43 "DELETE /v2.0/subnets/54fa88c0-5b07-4018-9346-f1d3f6f3df1d HTTP/1.1" status: 204 len: 168 time: 0.2272134 Dec 14 03:15:41.796784 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50388) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:41.865527 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.944070 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.963314 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['adc7b7f7-be75-4e68-a215-6654c2c27cac']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:41.972630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45d9b456-a3f1-4779-951e-75d07e818a26') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:41.972928 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45d9b456-a3f1-4779-951e-75d07e818a26') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:15:41.982108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:41.995402 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.001103 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Releasing vlan 257 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:15:42.001487 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:15:42.003255 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:15:42.056472 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.061495 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.064713 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] 10.222.0.43 "DELETE /v2.0/networks/adc7b7f7-be75-4e68-a215-6654c2c27cac HTTP/1.1" status: 204 len: 168 time: 0.2670345 Dec 14 03:15:42.078241 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f7dc147-34b8-4fb1-8714-7d7a2ec75875 admin admin] Pushing event deleted for resources: {'Network': ['ID=adc7b7f7-be75-4e68-a215-6654c2c27cac,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:42.231325 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50394) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:42.271784 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0e776527-97df-4ac5-b656-0149e8d0ea37 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7efcbf12d6654bc68690363892415b77&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0390811 Dec 14 03:15:42.274107 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50396) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:42.324444 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.345460 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.395890 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.398565 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:42.400011 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/344c1b72-e136-4965-9073-719e9454c82f HTTP/1.1" status: 204 len: 168 time: 0.1247606 Dec 14 03:15:42.412390 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6623add5-a4b8-4f71-b4b2-0bccff11a00e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=344c1b72-e136-4965-9073-719e9454c82f,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:43.133940 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 50428) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:43.227228 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1649092035-network', 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:43.248350 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:43.250687 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.259318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.333213 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.336887 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.364630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 282} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:15:43.373988 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8c9bd0d-623a-43f5-95cb-d6df61f221ba,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:43.380480 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.380847 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Added segment 36876166-6080-44fb-9026-20129e125f6e of type vlan for network 69a3889e-636a-4983-9398-edafd7db5301 Dec 14 03:15:43.420016 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.446452 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.447497 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:43.448106 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.503124 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3680437 Dec 14 03:15:43.506027 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50436) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:43.509876 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d10bdfc0-ac92-4c95-914e-505280b91ac0 admin admin] Pushing event updated for resources: {'Network': ['ID=69a3889e-636a-4983-9398-edafd7db5301,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:43.511306 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Request body: {'subnet': {'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1649092035-subnet', 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:43.519725 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 69a3889e-636a-4983-9398-edafd7db5301 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:15:43.531428 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:43.533730 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.702864 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.758982 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5cfcc7bf-6dc9-4045-a09c-867974704f94,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:43.767637 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Checking segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:43.767993 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Network hostable DHCP agents. Network: 69a3889e-636a-4983-9398-edafd7db5301, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:15:43.784915 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Network 69a3889e-636a-4983-9398-edafd7db5301 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:15:43.793771 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 69a3889e-636a-4983-9398-edafd7db5301) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:43.798519 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:43.799185 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:43.802534 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec4356c9-a446-48f1-b066-cdda46480aee None None] Network 69a3889e-636a-4983-9398-edafd7db5301 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:43.817012 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-42e4f498-c3a2-4e9f-96f1-1acc039399b3 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3097792 Dec 14 03:15:43.918995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c0e579a-5169-4612-8461-6165c18c99c5 None None] Network 69a3889e-636a-4983-9398-edafd7db5301 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:15:49.641648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-30258310-ec14-4982-a39c-f8a2edf5b58b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:51.803429 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70194c39-1fd0-42c7-9b89-0daf16648449 req-4e48abaf-f546-443d-9eae-3ebab542f57f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:51.804969 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70194c39-1fd0-42c7-9b89-0daf16648449 req-4e48abaf-f546-443d-9eae-3ebab542f57f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0569279 Dec 14 03:15:51.855280 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-53aa68ae-674e-4a28-afe9-2b5d6d70b666 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:51.875607 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70194c39-1fd0-42c7-9b89-0daf16648449 req-153015fe-bf36-4397-9b0a-72c976908b47 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645711 Dec 14 03:15:52.049848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-a9adebae-03d8-4914-97de-82f1327b940d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:52.051889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-a9adebae-03d8-4914-97de-82f1327b940d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1000922 Dec 14 03:15:52.066064 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-840e0c45-f5dd-48d6-ab2e-91d9edb9747f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/quotas/7ecea5c13a624ab8a3a445d3ede5fd77 HTTP/1.1" status: 200 len: 375 time: 0.0085762 Dec 14 03:15:52.096057 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-53815bec-c1a4-489c-9d94-934b797e9be2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249057 Dec 14 03:15:52.184152 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-bf2e4e5b-3518-4726-b1e9-3fe384bc9da1 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808704 Dec 14 03:15:52.270531 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-c23b8317-a775-433c-a380-8a8e0db010cf service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799799 Dec 14 03:15:52.427742 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3b8337bb-dced-4759-86f1-30bbcd0093e6 req-896ee99d-0209-4ff4-b64e-83463f7ec800 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 210 time: 0.0275562 Dec 14 03:15:52.992615 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 req-d86a83f6-50c2-4458-a969-1f45e73323cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:52.992615 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 req-d86a83f6-50c2-4458-a969-1f45e73323cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0510986 Dec 14 03:15:53.054214 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 req-1c0e6982-22ff-48f6-8690-3bb8379dab89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533693 Dec 14 03:15:53.197940 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50786) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:53.327638 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-e279e412-770e-4e3d-8c08-2387c797f8d3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=722b58145d434e1181ebd90e63eb1255&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1285512 Dec 14 03:15:53.330170 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 50792) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:15:53.375750 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:53.396988 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:53.443949 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:53.446610 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:53.447785 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/da239b48-d36b-466f-952b-adf047af168b HTTP/1.1" status: 204 len: 168 time: 0.1167047 Dec 14 03:15:53.458979 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e1a618-d86e-41b8-9eaa-bee2f7e25139 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da239b48-d36b-466f-952b-adf047af168b,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:53.535109 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cd4ad081-6a83-491f-b768-20f112ab0bb0 req-b1d4144c-60ec-4126-b787-d8964022ed95 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 210 time: 0.0271957 Dec 14 03:15:53.564165 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:53.628475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 8512939b-7934-497d-9e64-85606ebc8347 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:15:53.652112 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 8512939b-7934-497d-9e64-85606ebc8347 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:15:53.652731 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 8512939b-7934-497d-9e64-85606ebc8347 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:15:53.706577 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-a34c15ac-25b8-4f12-a7b4-6a1b54b69e2f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:53.708393 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-a34c15ac-25b8-4f12-a7b4-6a1b54b69e2f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1275039 Dec 14 03:15:53.745417 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Request body: {'port': {'device_id': 'de04da40-f5fd-43e2-b454-20a219642030', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'admin_state_up': True, 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:53.858656 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:15:53.862555 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:54.014133 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Allocated IP 172.20.0.8 (69a3889e-636a-4983-9398-edafd7db5301/5cfcc7bf-6dc9-4045-a09c-867974704f94/b60f528b-8a43-4d0c-83ea-77e6e41b0fe5) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:15:54.163715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:54.196716 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:54.237711 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Network 69a3889e-636a-4983-9398-edafd7db5301 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:15:54.241923 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:15:54.245513 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:15:54.268724 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event updated for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:54.295928 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:54.296521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:54.317034 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-70078278-2c9b-4695-b244-27f527db9fb7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5756452 Dec 14 03:15:54.534816 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:55.773916 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:59.497398 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Request body: {'port': {'device_id': 'de04da40-f5fd-43e2-b454-20a219642030', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:15:59.556148 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:59.653434 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8876ea8b-2601-4585-953f-173791efac5d req-12fe872b-122c-43f8-8200-1d5824e04c05 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:59.654906 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8876ea8b-2601-4585-953f-173791efac5d req-12fe872b-122c-43f8-8200-1d5824e04c05 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0523744 Dec 14 03:15:59.731715 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd req-b04fb274-bf72-4a5f-a4db-7398df454c37 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:15:59.733376 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd req-b04fb274-bf72-4a5f-a4db-7398df454c37 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 931 time: 0.0774446 Dec 14 03:15:59.745420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8876ea8b-2601-4585-953f-173791efac5d req-3a6d4477-05f0-4104-adab-fe895a92f901 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786667 Dec 14 03:15:59.799450 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd req-e45c22f3-3ce9-4992-83aa-babbea3cd16b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462499 Dec 14 03:15:59.830063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:15:59.839479 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:59.851679 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Transition to ACTIVE for port object b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:15:59.855807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:15:59.905321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Pushing event updated for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:15:59.972745 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Attempting to bind port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:15:59.973073 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Attempting to bind port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:15:59.973397 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Attempting to bind port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:59.977444 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 on network 69a3889e-636a-4983-9398-edafd7db5301 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:15:59.977753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Attempting to bind port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:15:59.982344 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:15:59.982669 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Checking segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:15:59.983060 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Bound using segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:15:59.983480 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Bound port: b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:15:59.983819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:00.043493 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:00.046377 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:00.049817 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:00.083569 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.084169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:00.085500 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-87f5468c-6200-4594-852d-08c897795ebe service neutron] 10.222.0.20 "PUT /v2.0/ports/b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 HTTP/1.1" status: 200 len: 1093 time: 0.5923884 Dec 14 03:16:00.085959 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:16:00.088194 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde" -d '{"events": [{"name": "network-changed", "server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:16:00.109216 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f5468c-6200-4594-852d-08c897795ebe service neutron] Pushing event updated for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:00.122027 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1aff381-7127-4436-886f-52ef096d7259 x-openstack-request-id: req-a1aff381-7127-4436-886f-52ef096d7259 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:16:00.122314 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:16:00.122568 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a1aff381-7127-4436-886f-52ef096d7259 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:16:00.122958 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', 'status': 'completed', 'code': 200} Dec 14 03:16:00.282968 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-e11cb542-f5a1-430f-9c7c-abad56673fac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.284344 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-e11cb542-f5a1-430f-9c7c-abad56673fac service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 1096 time: 0.0398538 Dec 14 03:16:00.390043 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-9a524d8f-e154-4582-a8c2-dcc7866d8c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.391542 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-9a524d8f-e154-4582-a8c2-dcc7866d8c72 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0912557 Dec 14 03:16:00.484969 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a97a130a-6272-4e8b-a303-bfff90a2b11a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.486378 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a97a130a-6272-4e8b-a303-bfff90a2b11a service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0859632 Dec 14 03:16:00.621804 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-36c7c91f-d5d9-42c8-9f73-41b5016d8739 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.623361 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-36c7c91f-d5d9-42c8-9f73-41b5016d8739 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 1096 time: 0.0450425 Dec 14 03:16:00.714678 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-f232799b-970b-42af-8aed-768fcd8fe42f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 HTTP/1.1" status: 200 len: 217 time: 0.0357008 Dec 14 03:16:00.859990 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 req-53b6a54b-f50d-4216-aba7-0b66658d1d54 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.861518 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 req-53b6a54b-f50d-4216-aba7-0b66658d1d54 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0511804 Dec 14 03:16:00.883014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-ea00860b-9f62-4dd3-817a-47fa25feb61a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:00.884464 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-ea00860b-9f62-4dd3-817a-47fa25feb61a service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0433614 Dec 14 03:16:00.907286 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 req-e8a376ba-c18b-4c46-9497-daf3d001fd05 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389440 Dec 14 03:16:00.957516 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-01e3cf73-0b94-450d-85ac-25e132ff2a73 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262725 Dec 14 03:16:01.009065 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa108e1-e48f-41b6-bf7c-656506f9708f req-aca46f1f-0e83-4c4f-88b1-9f95a71518b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:01.010499 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8aa108e1-e48f-41b6-bf7c-656506f9708f req-aca46f1f-0e83-4c4f-88b1-9f95a71518b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 943 time: 0.0483260 Dec 14 03:16:01.051813 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-0460441b-ec46-45d9-bb23-938496a78c26 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860200 Dec 14 03:16:01.061759 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8aa108e1-e48f-41b6-bf7c-656506f9708f req-891a1ba1-2cf9-4ca7-968c-43bf940f1be8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451677 Dec 14 03:16:01.372618 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e8e09358-7dfd-4938-81f1-3ac13c621f0c req-1440c964-0ecb-41e3-813f-f2f21b8b5d89 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3133862 Dec 14 03:16:02.037083 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7086c0-f3e9-43f2-915b-af624efcb666 req-9adc06ae-bb2d-40f5-bee7-d48efccbf87d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:02.041562 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1e7086c0-f3e9-43f2-915b-af624efcb666 req-9adc06ae-bb2d-40f5-bee7-d48efccbf87d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0602853 Dec 14 03:16:02.091609 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1e7086c0-f3e9-43f2-915b-af624efcb666 req-943a3037-db72-42b9-85ef-252d693d18f6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461006 Dec 14 03:16:02.259385 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c33dd34-b174-417c-ac19-b86ea8668dd9 req-6496018c-21a0-4f19-a28b-8c397f46a8f1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:02.260849 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1c33dd34-b174-417c-ac19-b86ea8668dd9 req-6496018c-21a0-4f19-a28b-8c397f46a8f1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 943 time: 0.0542772 Dec 14 03:16:02.307276 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1c33dd34-b174-417c-ac19-b86ea8668dd9 req-8e12bcf7-927b-4d1d-93a0-f385a0b75f66 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403910 Dec 14 03:16:03.204760 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42835d83-3523-48ce-97ab-c96420d07dc6 req-00869046-7d72-45f8-a2b7-8f4284f0d7a1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:03.206230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-42835d83-3523-48ce-97ab-c96420d07dc6 req-00869046-7d72-45f8-a2b7-8f4284f0d7a1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0483601 Dec 14 03:16:03.253559 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-42835d83-3523-48ce-97ab-c96420d07dc6 req-836ceab4-f2ae-45e6-a29c-17e9bfe5e105 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407560 Dec 14 03:16:10.354541 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c344194f-5307-477c-9d38-360d72993a38 req-46c91760-c391-4b4d-8006-b2b9ce570c0e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:10.356023 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c344194f-5307-477c-9d38-360d72993a38 req-46c91760-c391-4b4d-8006-b2b9ce570c0e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 943 time: 0.0802610 Dec 14 03:16:10.364759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8536522b-1274-4b41-9ff4-abe7f280d5ef req-4cdbe187-9196-4c7d-85d1-e0a7630a7b78 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:10.366188 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8536522b-1274-4b41-9ff4-abe7f280d5ef req-4cdbe187-9196-4c7d-85d1-e0a7630a7b78 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0627074 Dec 14 03:16:10.436729 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c344194f-5307-477c-9d38-360d72993a38 req-41d7f080-f017-46f7-a6b8-890ccdd401c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695481 Dec 14 03:16:10.440579 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8536522b-1274-4b41-9ff4-abe7f280d5ef req-204462e4-73e2-4f66-9e1e-bf6aee8134a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661976 Dec 14 03:16:11.160642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:11.587493 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 req-c611de69-9e9e-4565-bcf6-8fce5cf69830 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:11.589126 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 req-c611de69-9e9e-4565-bcf6-8fce5cf69830 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0748036 Dec 14 03:16:11.598072 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b req-06df9c7b-d792-4db7-8aff-48c2b7738d66 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:11.600059 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b req-06df9c7b-d792-4db7-8aff-48c2b7738d66 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 943 time: 0.0942919 Dec 14 03:16:11.668418 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 req-bb046cee-23f4-467d-b417-76e5d84a22ae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674181 Dec 14 03:16:11.687425 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b req-ebc28c3b-f4d7-4bfa-960e-1d37234c4e39 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807214 Dec 14 03:16:13.965700 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:16:17.674019 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed125781-eec3-4364-8644-c98733aa4082 req-edf0f33d-23b9-47c9-bf55-013066dd5f10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:17.675525 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed125781-eec3-4364-8644-c98733aa4082 req-edf0f33d-23b9-47c9-bf55-013066dd5f10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0757558 Dec 14 03:16:17.696785 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f2554e-8980-48a1-8fd8-72630ab97f4a req-12bf9b9b-5a30-431c-a80b-ca87cb779f47 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:17.698154 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14f2554e-8980-48a1-8fd8-72630ab97f4a req-12bf9b9b-5a30-431c-a80b-ca87cb779f47 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 943 time: 0.0704546 Dec 14 03:16:17.760135 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed125781-eec3-4364-8644-c98733aa4082 req-a2e1a91a-6de1-42d6-9f0d-38c6c77a198c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764749 Dec 14 03:16:17.767309 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14f2554e-8980-48a1-8fd8-72630ab97f4a req-2ce3ef9b-a4b1-4b1f-b4bf-bc4b998b596d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620792 Dec 14 03:16:17.914233 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:16:18.008349 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:18.019587 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'port_id': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', 'mac_address': 'fa:16:3e:cb:7c:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 282, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cfcc7bf-6dc9-4045-a09c-867974704f94', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:16:18.056990 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:18.070523 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:16:18.090763 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:18.094375 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:18.249134 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:18.256618 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.256997 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.257346 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.257686 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.258019 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.258348 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.258676 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.259015 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.259362 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.259701 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.260028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.260349 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.260670 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:18.982955 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b68d1350-2fcf-4459-83e3-76aeb964eb8c req-a0af031f-81e8-4b9e-a844-fcb6a0fbd89b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:18.984461 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b68d1350-2fcf-4459-83e3-76aeb964eb8c req-a0af031f-81e8-4b9e-a844-fcb6a0fbd89b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0513525 Dec 14 03:16:19.058609 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b68d1350-2fcf-4459-83e3-76aeb964eb8c req-52168d19-1c82-4348-92db-784c834a818e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668502 Dec 14 03:16:19.066711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38d9b51-89ac-4924-a827-21ccf58f6d86 req-8845a419-cb8d-4c60-9ecf-af1c6ef656ac tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:19.068191 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e38d9b51-89ac-4924-a827-21ccf58f6d86 req-8845a419-cb8d-4c60-9ecf-af1c6ef656ac tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 944 time: 0.0776126 Dec 14 03:16:19.118389 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e38d9b51-89ac-4924-a827-21ccf58f6d86 req-8156e028-0647-4e61-ab98-491d9a855399 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441909 Dec 14 03:16:19.647608 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2b65f47a-4f5b-4e3f-80bc-751557295899 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:19.713175 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:16:19.897854 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cb0a0f-839c-4d6a-959f-394cd6aa68c0 req-8113af07-0269-4caf-99e3-695872f50ffe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:19.899306 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-77cb0a0f-839c-4d6a-959f-394cd6aa68c0 req-8113af07-0269-4caf-99e3-695872f50ffe service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1099 time: 0.0409122 Dec 14 03:16:19.953989 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-77cb0a0f-839c-4d6a-959f-394cd6aa68c0 req-1a4c7b57-8834-438a-b85a-64f7af64fef9 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456054 Dec 14 03:16:21.848710 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-10be4b75-2add-453a-b7c8-657a8a73ddb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:23.565769 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:24.537019 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:25.775841 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:25.882072 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee690ec-e628-42ae-b108-b745a136a535 req-e2f2db6a-9f63-435f-9ddd-8fba1c50c55a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:25.883476 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ee690ec-e628-42ae-b108-b745a136a535 req-e2f2db6a-9f63-435f-9ddd-8fba1c50c55a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0479980 Dec 14 03:16:25.930538 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ee690ec-e628-42ae-b108-b745a136a535 req-f2fefd4b-d9f7-479d-8792-89aff1c8865d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413179 Dec 14 03:16:26.036467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a66a3e8-c251-48f3-9c19-21e120726470 req-d551ca1d-ea03-49ad-8d99-9218a88d3e1d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:26.037901 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6a66a3e8-c251-48f3-9c19-21e120726470 req-d551ca1d-ea03-49ad-8d99-9218a88d3e1d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 944 time: 0.0471339 Dec 14 03:16:26.082844 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6a66a3e8-c251-48f3-9c19-21e120726470 req-b7ea46ba-80cc-4611-b372-5f9d2b3459cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391762 Dec 14 03:16:27.053573 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 req-47c00948-6ed3-4a79-bb56-4ee6d7482361 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:27.055062 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 req-47c00948-6ed3-4a79-bb56-4ee6d7482361 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0519152 Dec 14 03:16:27.103719 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 req-8c7ad267-0e15-46f4-baf2-b659f25c7bf0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425262 Dec 14 03:16:27.208022 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b1f4ea-eee3-474e-8900-c9f956305dcd req-40223242-8077-40aa-9902-95a877d4932f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:27.209503 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71b1f4ea-eee3-474e-8900-c9f956305dcd req-40223242-8077-40aa-9902-95a877d4932f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 944 time: 0.0479672 Dec 14 03:16:27.260938 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71b1f4ea-eee3-474e-8900-c9f956305dcd req-3cf16c90-3ef1-4abe-8bfa-6a21172751ea tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456054 Dec 14 03:16:29.167285 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:29.215875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:16:29.219344 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:29.219713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:29.292771 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:29.314446 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:16:29.316690 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13728d8e-7e86-4a26-8e56-566f69f056f9" -d '{"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-plugged", "status": "completed", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:16:29.328641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:29.332176 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:29.380872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:31.985881 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7335282c-18c1-4d06-9e24-701223e7e7ca req-fbe3294d-adf7-4d46-a629-3b551dc321be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:31.987348 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7335282c-18c1-4d06-9e24-701223e7e7ca req-fbe3294d-adf7-4d46-a629-3b551dc321be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0784433 Dec 14 03:16:32.022818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4a94f9-81ae-44cb-a0ff-8c93358671af req-d0a24773-527f-4ba1-a29d-43403458946c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:32.024417 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-db4a94f9-81ae-44cb-a0ff-8c93358671af req-d0a24773-527f-4ba1-a29d-43403458946c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0751512 Dec 14 03:16:32.062884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7335282c-18c1-4d06-9e24-701223e7e7ca req-50c77b53-f2a4-4ace-9d29-3afcdfb7e0f5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681903 Dec 14 03:16:32.097456 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-db4a94f9-81ae-44cb-a0ff-8c93358671af req-ef5d5ed8-0e6f-40a7-86a0-90625956e43a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637505 Dec 14 03:16:32.104136 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:16:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3960dec-d73f-4030-bc15-035c618bd72a x-openstack-request-id: req-f3960dec-d73f-4030-bc15-035c618bd72a {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:16:32.104641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-plugged", "status": "completed", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:16:32.104641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f3960dec-d73f-4030-bc15-035c618bd72a {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:16:32.105048 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', 'code': 200} Dec 14 03:16:32.325904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3562c7-c4d0-42fb-84ff-f3460b9cc282 req-5e358bca-72e7-498a-8e57-781566894809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:32.327382 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-4a3562c7-c4d0-42fb-84ff-f3460b9cc282 req-5e358bca-72e7-498a-8e57-781566894809 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 1098 time: 0.0379720 Dec 14 03:16:32.371433 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-4a3562c7-c4d0-42fb-84ff-f3460b9cc282 req-b4f20e19-15f4-4543-9fb2-49222ff0b77d service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362384 Dec 14 03:16:33.707801 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7544f536-c998-4a64-b099-6d1b5f4a6228 req-0c911029-7338-41d5-88e9-3cdc8c74ec02 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:33.709234 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7544f536-c998-4a64-b099-6d1b5f4a6228 req-0c911029-7338-41d5-88e9-3cdc8c74ec02 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0474446 Dec 14 03:16:33.761066 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7544f536-c998-4a64-b099-6d1b5f4a6228 req-78e75ccc-12ac-4835-abcf-a79bcd0aec21 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458951 Dec 14 03:16:33.821959 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 req-cd37a4b3-0506-43ec-b9a1-3d1e3240b357 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:33.823636 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 req-cd37a4b3-0506-43ec-b9a1-3d1e3240b357 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0518229 Dec 14 03:16:33.887539 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 req-e961ba42-5b75-4f2a-a7c5-883b43df4c71 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568974 Dec 14 03:16:34.881668 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b49a622-4183-4d91-b14e-03ae53947d42 req-0a97615f-4b72-4ef1-b495-67ed33e84360 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:34.883238 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8b49a622-4183-4d91-b14e-03ae53947d42 req-0a97615f-4b72-4ef1-b495-67ed33e84360 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0527401 Dec 14 03:16:34.940138 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8b49a622-4183-4d91-b14e-03ae53947d42 req-3443464e-7a6c-4e65-a788-cb055ef0a96e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502114 Dec 14 03:16:35.015685 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b855a2-abcd-40de-8fb8-783d632686eb req-91953914-f76a-4c8c-8699-071844119b9f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:35.017141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8b855a2-abcd-40de-8fb8-783d632686eb req-91953914-f76a-4c8c-8699-071844119b9f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0533924 Dec 14 03:16:35.093284 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8b855a2-abcd-40de-8fb8-783d632686eb req-c0232648-76a8-4737-9fbb-140fda308190 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671043 Dec 14 03:16:35.108510 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 req-c14d6739-63ec-4a62-aa5e-cc547545cc29 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:35.108510 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 req-c14d6739-63ec-4a62-aa5e-cc547545cc29 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0860295 Dec 14 03:16:35.161648 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 req-7ff730c5-691a-40fe-8696-7702f6c6724e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502965 Dec 14 03:16:36.224222 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed979463-4f40-403a-abb1-44906725be8f req-7b1ac81b-5527-44d8-9669-854ca6a8d6e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:36.225862 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed979463-4f40-403a-abb1-44906725be8f req-7b1ac81b-5527-44d8-9669-854ca6a8d6e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0505970 Dec 14 03:16:36.296100 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed979463-4f40-403a-abb1-44906725be8f req-fa2d06eb-1434-46dc-bd21-408a16145e47 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584233 Dec 14 03:16:36.453237 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51394) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:36.577217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.658153 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.662737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.700222 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=663addf663794cdb9f10a8bfe14d990d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2456355 Dec 14 03:16:36.700914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83fc79fb-7d72-4dd9-a5df-1ca5c5ea6555,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:36.702715 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51404) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:36.713931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.714279 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.714625 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.714963 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.715331 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.715652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.715983 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.716309 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.716635 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.716961 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.717284 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.717605 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.717925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99b2b27b-1502-41b0-8399-bc9e2cd3f2b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:36.760759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.780759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.828681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.831392 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:36.835390 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/83fc79fb-7d72-4dd9-a5df-1ca5c5ea6555 HTTP/1.1" status: 204 len: 168 time: 0.1316533 Dec 14 03:16:36.845209 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9749ee-c673-4990-b393-ca1bc6220ee2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83fc79fb-7d72-4dd9-a5df-1ca5c5ea6555,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:37.799650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 req-3e0e34f9-e590-4b93-bb3a-c160ed445978 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:37.801774 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 req-3e0e34f9-e590-4b93-bb3a-c160ed445978 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0534356 Dec 14 03:16:37.811532 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-318bd9ac-c1e9-4ff7-97b2-97c405c7d91e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:37.813590 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-318bd9ac-c1e9-4ff7-97b2-97c405c7d91e service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0482440 Dec 14 03:16:37.851390 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 req-5b64d769-1467-45ec-8fce-f192d93a14f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431645 Dec 14 03:16:37.927400 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-73c797c5-32cc-4a7d-9f63-9398d1091ce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:37.929327 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-73c797c5-32cc-4a7d-9f63-9398d1091ce2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1058624 Dec 14 03:16:37.985223 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-4954f19e-a3f3-4a3b-a3b5-1073111358ca service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0401199 Dec 14 03:16:38.038844 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-25c5c76b-b196-4bca-bd0e-a580b8c81c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:38.040356 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-25c5c76b-b196-4bca-bd0e-a580b8c81c5d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0477002 Dec 14 03:16:38.073489 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-db3d9cc7-8a13-4a66-ab39-a7bb0aa86883 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251961 Dec 14 03:16:38.164476 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-7e3abac8-fe5b-417b-904f-47df44021705 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829611 Dec 14 03:16:38.264587 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 req-77f81100-2be6-4f6c-8f25-26300b32c106 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817018 Dec 14 03:16:38.975033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee req-16d1b78b-1020-4469-a892-000b7bc86e5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:38.976544 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee req-16d1b78b-1020-4469-a892-000b7bc86e5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0488944 Dec 14 03:16:39.040302 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee req-ab0c29ec-de3f-4a62-9589-c7d0bd00b73c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571656 Dec 14 03:16:40.175963 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 req-6f0afdaf-f035-453b-8fdf-3441f34a3d31 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:40.177884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 req-6f0afdaf-f035-453b-8fdf-3441f34a3d31 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0621474 Dec 14 03:16:40.234060 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 req-b21ffcee-f4e7-447b-b8f1-48220c0c7869 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503125 Dec 14 03:16:40.466104 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51574) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:40.588525 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d4ec5d7-1c4f-4cb7-909c-77f0c7b21d8e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.664752 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d4ec5d7-1c4f-4cb7-909c-77f0c7b21d8e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.668598 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9d4ec5d7-1c4f-4cb7-909c-77f0c7b21d8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.704885 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d4ec5d7-1c4f-4cb7-909c-77f0c7b21d8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a8e37b7-0ff8-4719-a5ea-c2a1f6c51ba0,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:40.709618 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-9d4ec5d7-1c4f-4cb7-909c-77f0c7b21d8e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5d6b67a0a79f410abcade4cf7ea0b9d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2425082 Dec 14 03:16:40.712315 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51582) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:40.762278 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.783879 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.836009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.838459 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:40.839618 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4a8e37b7-0ff8-4719-a5ea-c2a1f6c51ba0 HTTP/1.1" status: 204 len: 168 time: 0.1264851 Dec 14 03:16:40.847731 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e580ba-b815-4442-afb9-de297bb71106 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a8e37b7-0ff8-4719-a5ea-c2a1f6c51ba0,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:41.048004 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 51606) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:41.151276 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.180945 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.234730 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.240118 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.277853 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9b04ace497f7403cb908d2381ac0cbd1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2287545 Dec 14 03:16:41.280640 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51622) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:41.283585 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb3c0496-f98e-4de3-967d-0ce7e604b789,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:41.297528 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.298197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.298768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.299524 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.300047 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.301211 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.301630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.302088 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.302494 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.302900 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.303323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.303725 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.304150 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a2683f-85d1-4f0a-b813-b988242e71fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:41.371889 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.411516 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6f68bc-9974-4e61-8208-d2de29f36cbe req-e3cd5afb-0ba6-4a84-ba6f-7abf3e92abfa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:41.413025 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5c6f68bc-9974-4e61-8208-d2de29f36cbe req-e3cd5afb-0ba6-4a84-ba6f-7abf3e92abfa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0825894 Dec 14 03:16:41.414973 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.482880 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5c6f68bc-9974-4e61-8208-d2de29f36cbe req-e3e2ce44-ac51-4bb5-a09c-5daed89e4b2c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612381 Dec 14 03:16:41.508297 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.511112 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.514655 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fb3c0496-f98e-4de3-967d-0ce7e604b789 HTTP/1.1" status: 204 len: 168 time: 0.2302334 Dec 14 03:16:41.532544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45d8ec5-7d1e-4c46-a0ef-eea58ec5d53e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb3c0496-f98e-4de3-967d-0ce7e604b789,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:41.548583 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 51636) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:41.589699 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-dcc57d95-296e-4b81-954b-eb77d5521b47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:41.591953 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-dcc57d95-296e-4b81-954b-eb77d5521b47 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0519600 Dec 14 03:16:41.700772 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-465714400-network', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:41.749682 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Made reservation on behalf of bc2e5ee76edf4e358f418773bf824ed7 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:16:41.751998 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.762055 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-bd1cbc94-a74b-4a09-a0fa-24b2ad4ed5d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:41.767468 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-bd1cbc94-a74b-4a09-a0fa-24b2ad4ed5d3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1502247 Dec 14 03:16:41.768303 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.822977 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-db2a1a89-1c93-4045-b2c6-57502486da30 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0438738 Dec 14 03:16:41.895969 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-a23cb019-6dce-412b-854e-e63141aec522 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:41.897436 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-a23cb019-6dce-412b-854e-e63141aec522 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0670707 Dec 14 03:16:41.942272 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-cfe1909e-bc91-4b4b-a2c9-4f220d36b8c0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0348911 Dec 14 03:16:41.947434 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:41.951351 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.030362 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 251} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:16:42.041593 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5aea58c-8de2-497c-802a-0d4e5575f808,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:42.051785 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.052384 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Added segment c0cd6eb9-f6bc-4666-858b-bca42d1674d0 of type vlan for network f2ccc364-1044-4d86-92a1-159741b0fffd Dec 14 03:16:42.111375 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.123088 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-d17cc2c0-ca15-476d-ac11-956c8b233066 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1597011 Dec 14 03:16:42.189360 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.190334 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:42.190948 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.249161 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6984811 Dec 14 03:16:42.252283 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51664) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:42.257834 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Request body: {'subnet': {'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-465714400-subnet', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:42.276828 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eedc02f-8cfd-45f5-98c9-60395beeb931 admin admin] Pushing event updated for resources: {'Network': ['ID=f2ccc364-1044-4d86-92a1-159741b0fffd,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:42.287570 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network f2ccc364-1044-4d86-92a1-159741b0fffd details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:16:42.290406 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fd37e71-6548-41d3-9cfc-c6e4ae74c4a7 req-59cecfd8-8330-437e-9e43-15ce38d1a303 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1568811 Dec 14 03:16:42.321521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Made reservation on behalf of bc2e5ee76edf4e358f418773bf824ed7 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:16:42.325249 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.502914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.577944 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b4783ac-1363-4237-9ce6-75efb61eaefb,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:42.619187 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Checking segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:42.619547 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Network hostable DHCP agents. Network: f2ccc364-1044-4d86-92a1-159741b0fffd, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:16:42.642170 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479bc359-e78b-429a-a587-0200f5e46c96 req-e00ed841-8e83-4a63-8cb5-ac3eeca0132f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:42.643821 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-479bc359-e78b-429a-a587-0200f5e46c96 req-e00ed841-8e83-4a63-8cb5-ac3eeca0132f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0748672 Dec 14 03:16:42.677303 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Network f2ccc364-1044-4d86-92a1-159741b0fffd is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:16:42.697489 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, f2ccc364-1044-4d86-92a1-159741b0fffd) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:42.707014 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:42.707729 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.711881 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2b05bce-468b-4cc6-bfe8-3fc7c4af3518 None None] Network f2ccc364-1044-4d86-92a1-159741b0fffd requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:16:42.714195 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-479bc359-e78b-429a-a587-0200f5e46c96 req-d43a7380-b525-4c6f-87a6-f7ee7c594c33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635259 Dec 14 03:16:42.730029 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-919c8018-1199-4fa2-9c26-05f022a0cbe8 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4765134 Dec 14 03:16:42.733143 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51678) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:42.739912 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:42.769817 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.771217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.834441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.881139 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-f2ccc364-1044-4d86-92a1-159741b0fffd', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:16:42.888743 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:42.977587 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.057012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Allocated IP 172.20.0.2 (f2ccc364-1044-4d86-92a1-159741b0fffd/4b4783ac-1363-4237-9ce6-75efb61eaefb/325a5471-9faf-4abb-b7be-4f4f49d2b904) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:43.196217 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.202720 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.249048 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Network f2ccc364-1044-4d86-92a1-159741b0fffd is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:43.251894 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:43.255115 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:43.261129 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Pushing event updated for resources: {'Port': ['ID=325a5471-9faf-4abb-b7be-4f4f49d2b904,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:43.323581 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Attempting to bind port 325a5471-9faf-4abb-b7be-4f4f49d2b904 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:43.324668 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Attempting to bind port 325a5471-9faf-4abb-b7be-4f4f49d2b904 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:43.325270 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Attempting to bind port 325a5471-9faf-4abb-b7be-4f4f49d2b904 on network f2ccc364-1044-4d86-92a1-159741b0fffd {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:43.332474 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:43.332802 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Checking segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:43.333274 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.334808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Bound using segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:43.334808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Bound port: 325a5471-9faf-4abb-b7be-4f4f49d2b904, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:43.334808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.380408 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.401107 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.402765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] For port 325a5471-9faf-4abb-b7be-4f4f49d2b904, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:43.405782 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] For port 325a5471-9faf-4abb-b7be-4f4f49d2b904, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=325a5471-9faf-4abb-b7be-4f4f49d2b904,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:43.411268 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.467434 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934614ee-8bca-4d52-a8d4-e41a5a65e209 None None] Pushing event updated for resources: {'Port': ['ID=325a5471-9faf-4abb-b7be-4f4f49d2b904,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:43.518379 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Allocated IP 172.27.3.150 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/3791fc7e-d6a0-4f44-ab90-7ba8b8a19100) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:43.621957 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.666472 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:43.719886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:43.723814 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:43.728526 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:43.731532 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Pushing event updated for resources: {'Port': ['ID=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:43.879918 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 req-6d31f916-0dc9-44ed-b46b-ed1edfdc1137 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:43.881372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 req-6d31f916-0dc9-44ed-b46b-ed1edfdc1137 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0811777 Dec 14 03:16:44.007524 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 req-24413d67-9aea-4a42-97dd-0b7642d1e9b9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944867 Dec 14 03:16:44.017858 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.217939 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.353460 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102571) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:16:44.442940 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 325a5471-9faf-4abb-b7be-4f4f49d2b904 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:44.469038 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebc262f7-2767-461c-9a31-47b2ea0c2d0f None None] Network f2ccc364-1044-4d86-92a1-159741b0fffd requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:16:44.488537 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:16:44.498145 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Sync routers for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:16:44.509867 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.510665 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:44.511294 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:44.511445 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-efddaf72-30c7-49a3-81ef-7a4a961fdd42 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.7770455 Dec 14 03:16:44.514116 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51706) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:44.544325 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-a25d77c9-a567-4715-9089-757945a49caf None None] Provisioning complete for port 325a5471-9faf-4abb-b7be-4f4f49d2b904 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:44.544932 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a25d77c9-a567-4715-9089-757945a49caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.604566 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 325a5471-9faf-4abb-b7be-4f4f49d2b904 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:44.604939 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.622578 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:44.734899 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a25d77c9-a567-4715-9089-757945a49caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.795734 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.803266 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-a25d77c9-a567-4715-9089-757945a49caf None None] For port 325a5471-9faf-4abb-b7be-4f4f49d2b904, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=325a5471-9faf-4abb-b7be-4f4f49d2b904,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:44.824857 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:43Z', 'revision_number': 3, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:44.825930 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a25d77c9-a567-4715-9089-757945a49caf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.859179 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Checking router: 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:16:44.859533 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Updating router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:16:44.886205 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:44.912591 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.db.api [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102573) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 14 03:16:44.912911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG oslo_db.api [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 14 03:16:44.931016 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25d77c9-a567-4715-9089-757945a49caf None None] Pushing event updated for resources: {'Port': ['ID=325a5471-9faf-4abb-b7be-4f4f49d2b904,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:45.045728 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.069024 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-0d5b7839-b321-4445-b060-ab63ffde8846 None None] Provisioning complete for port 325a5471-9faf-4abb-b7be-4f4f49d2b904 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:45.069397 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0d5b7839-b321-4445-b060-ab63ffde8846 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.194715 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.203019 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.232952 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 req-bc90044a-7dd9-4739-84d0-8023f03f68e9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:45.234472 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 req-bc90044a-7dd9-4739-84d0-8023f03f68e9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1136353 Dec 14 03:16:45.261076 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Pushing event updated for resources: {'Port': ['ID=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,revision_number=2']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:45.275361 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.275740 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.276102 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.276441 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.277135 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.277135 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.277410 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.278001 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.278500 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.278845 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.279203 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.279532 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.279858 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:16:45.298674 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 req-68263730-81e0-4405-ad85-f0762193f2ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562906 Dec 14 03:16:45.321101 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Attempting to bind port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:45.321790 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Attempting to bind port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:45.322564 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Attempting to bind port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:45.329315 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:45.330020 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:45.330628 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.331247 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:45.332728 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Bound port: 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:45.333505 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.356962 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Allocated IP 172.20.0.1 (f2ccc364-1044-4d86-92a1-159741b0fffd/4b4783ac-1363-4237-9ce6-75efb61eaefb/1f1825d8-5cf4-485e-a2c8-2412e7b8f483) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:45.405137 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] For port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:45.408660 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] For port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:45.413626 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.479580 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:45.480132 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:45.522775 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.556983 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.600667 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Network f2ccc364-1044-4d86-92a1-159741b0fffd is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:45.603668 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:45.607128 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:45.607599 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.624286 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e1803b-8107-48f8-9675-c3df73064477 None None] Pushing event updated for resources: {'Port': ['ID=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:45.646748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Pushing event updated for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:45.712483 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:45.758503 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.909114 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-54004d72-5a8b-476c-a806-f4c5e09cf9da None None] Provisioning complete for port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:45.910720 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-54004d72-5a8b-476c-a806-f4c5e09cf9da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.914801 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:43Z', 'revision_number': 3, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:45.956936 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9744266a-51fc-444e-ae99-f71f0edf43a4 None None] The sync data for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi is: [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:43Z', 'revision_number': 3, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:16:45.957437 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-54004d72-5a8b-476c-a806-f4c5e09cf9da None None] Port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:16:45.966958 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.980387 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:45.981239 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:46.082793 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Pushing event updated for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:46.129529 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Network f2ccc364-1044-4d86-92a1-159741b0fffd is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:46.130914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:46.490519 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-dce5ee43-cd2b-4289-bbab-0629de6454a5 None None] Provisioning complete for port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:46.491173 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-dce5ee43-cd2b-4289-bbab-0629de6454a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:46.552465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-dce5ee43-cd2b-4289-bbab-0629de6454a5 None None] Port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:16:46.571798 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:46.646482 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bdcf263-b892-4275-a434-30786a67f16d req-7137a55b-90ae-418b-a989-a85d24d334c6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:46.648317 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5bdcf263-b892-4275-a434-30786a67f16d req-7137a55b-90ae-418b-a989-a85d24d334c6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1786203 Dec 14 03:16:46.658578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:46.659032 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:46.679292 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:16:46.716429 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5bdcf263-b892-4275-a434-30786a67f16d req-fa076a95-b708-4fca-8967-5cc5f50b5d1e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615284 Dec 14 03:16:46.833920 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:16:46.850993 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-ee1b81d5-e41b-4bab-bb29-e328af2892cd admin admin] 10.222.0.43 "PUT /v2.0/routers/5c4f5fd8-fa7e-4996-8795-402edb6c7a72/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3357618 Dec 14 03:16:46.873935 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:46.898183 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:46.903451 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:46.904326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 325a5471-9faf-4abb-b7be-4f4f49d2b904 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:46.986606 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:46.995322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 325a5471-9faf-4abb-b7be-4f4f49d2b904 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:46.995667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.410813 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51768) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:47.415933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1736292880-network', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:47.442007 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Made reservation on behalf of 574a0ff076ae428999f919b34df1c6c8 for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:16:47.444661 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.453302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.531928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.536960 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.558282 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 281} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:16:47.573314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84ca51dc-aff0-40bf-aa79-0abdd5ed61b5,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:47.576181 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.576530 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Added segment 43ae2319-fd15-465f-bef2-747b3e5bb2be of type vlan for network fff3dc45-7393-4a44-8e77-f9ec683d1be8 Dec 14 03:16:47.628267 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.687461 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.688539 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:47.689302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.739105 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3269618 Dec 14 03:16:47.744392 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 51784) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:47.751284 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Request body: {'subnet': {'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1736292880-subnet', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:47.761054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f23e09-9dc6-4174-94a8-571055ce41de admin admin] Pushing event updated for resources: {'Network': ['ID=fff3dc45-7393-4a44-8e77-f9ec683d1be8,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:47.774108 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:16:47.782153 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Made reservation on behalf of 574a0ff076ae428999f919b34df1c6c8 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:16:47.784608 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8547576'] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:47.840466 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Sync routers for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:16:47.862258 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:47.862976 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:47.980389 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12248346', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8547558'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.027806 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:48.032036 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Pushing event updated for resources: {'Subnet': ['ID=49905273-bd25-4b7d-ac4b-f22b00cfcd1a,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:48.056653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Checking segment: {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:48.057041 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Network hostable DHCP agents. Network: fff3dc45-7393-4a44-8e77-f9ec683d1be8, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:16:48.077210 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:16:48.087417 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, fff3dc45-7393-4a44-8e77-f9ec683d1be8) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:48.091981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:48.092885 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.109747 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6902a1b-8269-485d-8778-8f449267c31d None None] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:16:48.114106 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 51792) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:48.115360 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ba2ddfad-2994-436c-b84a-387ea0689314 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3692532 Dec 14 03:16:48.120026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:16:48.143305 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.144950 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.193232 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.290178 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'fixed_ips': [{'subnet_id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:16:48.291034 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.328708 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.421704 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:48.445857 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 2, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:48.483627 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Checking router: 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:16:48.483985 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Updating router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:16:48.522901 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Allocated IP 172.20.0.2 (fff3dc45-7393-4a44-8e77-f9ec683d1be8/49905273-bd25-4b7d-ac4b-f22b00cfcd1a/fce16d5b-db9d-41c4-9b15-57f41b6e2de2) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:48.525788 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.532196 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.551338 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.620847 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:48.621221 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.652743 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Allocated IP 172.27.3.5 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:48.770280 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.802817 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.840908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:48.843884 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:48.847424 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:48.882875 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Pushing event updated for resources: {'Port': ['ID=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:48.896084 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.907922 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:48.971917 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:48.980734 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:48.987125 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:48.990779 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Pushing event updated for resources: {'Port': ['ID=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:49.062106 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.071740 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.081993 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.083825 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Attempting to bind port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:49.084193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Attempting to bind port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:49.084549 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Attempting to bind port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 on network fff3dc45-7393-4a44-8e77-f9ec683d1be8 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:49.241178 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:49.241554 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Checking segment: {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:49.241962 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.242347 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Bound using segment: {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:49.243486 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Bound port: fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:49.243486 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.263865 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.271430 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc9233e-6080-4b82-81d3-f1c04cda4eeb None None] Pushing event updated for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:49.359020 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Attempting to bind port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:49.359424 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Attempting to bind port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:49.359786 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Attempting to bind port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 on network f2ccc364-1044-4d86-92a1-159741b0fffd {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:49.371697 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:49.371926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Checking segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:49.372310 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.372741 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Bound using segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:49.373154 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Bound port: 1f1825d8-5cf4-485e-a2c8-2412e7b8f483, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:49.373538 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.375880 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] For port fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:49.379881 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] For port fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:49.387795 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.407943 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Router 43a3da57-3840-4a67-8a18-1714364c5636 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102571) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:16:49.482642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63178579-6c1d-4e1d-b883-a1092735f625 None None] Pushing event updated for resources: {'Port': ['ID=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:49.497569 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] For port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:49.502490 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] For port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:49.508886 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.520545 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:16:49.530370 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Sync routers for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:16:49.541026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.542308 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f090e3e9-b66c-4e76-86c9-fe1c5696b76e admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 1.4260824 Dec 14 03:16:49.545240 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 51802) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:16:49.545868 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:49.546026 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] Provisioning complete for port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:49.546370 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.546508 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:49.610769 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:49.612191 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:49.666363 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc9233e-6080-4b82-81d3-f1c04cda4eeb None None] Pushing event updated for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:49.710128 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:49.763657 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.793115 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-17d85151-da8f-4ce4-907f-675b5d380554 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.884573 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] For port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:49.897888 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:49.933954 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:50.025998 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:48Z', 'revision_number': 3, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:50.030360 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-392d1a83-fba4-46de-b57f-ad8779ea1a89 None None] Pushing event updated for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:50.060753 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Checking router: 43a3da57-3840-4a67-8a18-1714364c5636 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:16:50.061099 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Updating router 43a3da57-3840-4a67-8a18-1714364c5636 port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:16:50.086793 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.102399 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ee4d177b-af2c-4c8e-b83b-cb520993e418 None None] Provisioning complete for port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:50.102908 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ee4d177b-af2c-4c8e-b83b-cb520993e418 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.177333 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.270934 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:50.297703 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf1ba7a4-c07a-4ae2-8571-c6b56fd76c49 None None] The sync data for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi is: [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:16:50.354290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Allocated IP 172.20.0.1 (fff3dc45-7393-4a44-8e77-f9ec683d1be8/49905273-bd25-4b7d-ac4b-f22b00cfcd1a/d126ebc8-c629-45a9-8fa9-12005408d041) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:16:50.361991 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.377047 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.453520 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b9a258d-0729-41f1-9046-95a1408260b5 None None] Pushing event updated for resources: {'Port': ['ID=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,revision_number=2']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:50.489146 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Attempting to bind port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:50.489514 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Attempting to bind port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:50.489872 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Attempting to bind port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:50.495467 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:50.496709 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:50.499420 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.499883 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:50.500400 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Bound port: c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:50.500821 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.528413 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.577466 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] For port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:50.581412 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] For port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:50.586540 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.593016 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.597245 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:50.663601 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b9a258d-0729-41f1-9046-95a1408260b5 None None] Pushing event updated for resources: {'Port': ['ID=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:50.671935 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:50.672576 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:50.700540 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:50.704165 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:50.708410 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:16:50.726225 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:50.726593 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.740638 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Pushing event updated for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:50.766154 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:50.824103 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:50.864490 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fce16d5b-db9d-41c4-9b15-57f41b6e2de2 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:50.928183 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32df2b2b-ba7d-4e84-a8ef-49b637012903 None None] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:16:50.964804 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.000768 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:16:51.041193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:51.041713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.047267 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-e1297792-59a7-4a60-b959-341db7b510a7 None None] Provisioning complete for port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:51.047797 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e1297792-59a7-4a60-b959-341db7b510a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.101218 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:48Z', 'revision_number': 3, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:51.177819 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d0b290-f1f0-45f0-a948-d5b2db7d9767 None None] The sync data for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi is: [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:48Z', 'revision_number': 3, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:16:51.207630 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.218014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.276622 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.280764 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e1297792-59a7-4a60-b959-341db7b510a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.325672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Pushing event updated for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:51.339476 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.360779 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:51.370139 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:51.448565 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.db.api [None req-e1297792-59a7-4a60-b959-341db7b510a7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102573) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 14 03:16:51.448936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG oslo_db.api [None req-e1297792-59a7-4a60-b959-341db7b510a7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 14 03:16:51.472904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:16:51.474521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:16:51.478777 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:51.618740 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Router 43a3da57-3840-4a67-8a18-1714364c5636 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:16:51.758831 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:16:51.764586 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e326551e-b05e-4d17-b233-a6e6c5fb9f6f admin admin] 10.222.0.43 "PUT /v2.0/routers/43a3da57-3840-4a67-8a18-1714364c5636/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2176504 Dec 14 03:16:51.860391 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-46a3e611-a235-44bb-8fb5-985c53726c5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.117398 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-24df5e4a-9fab-4b69-bf88-b54e18c83e14 None None] Provisioning complete for port d126ebc8-c629-45a9-8fa9-12005408d041 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:52.117791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-24df5e4a-9fab-4b69-bf88-b54e18c83e14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.165302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-24df5e4a-9fab-4b69-bf88-b54e18c83e14 None None] Port d126ebc8-c629-45a9-8fa9-12005408d041 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:16:52.186624 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-24df5e4a-9fab-4b69-bf88-b54e18c83e14 None None] Provisioning complete for port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:52.187116 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-24df5e4a-9fab-4b69-bf88-b54e18c83e14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.238286 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb9a9f6-48ab-4563-9d08-160665499f53 req-f10d78bd-37a3-4420-bccf-419af79b444c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:52.254823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fcb9a9f6-48ab-4563-9d08-160665499f53 req-f10d78bd-37a3-4420-bccf-419af79b444c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0858481 Dec 14 03:16:52.335914 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fcb9a9f6-48ab-4563-9d08-160665499f53 req-664ad8bf-b16f-4574-a417-07185450d99e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733740 Dec 14 03:16:52.502950 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fce16d5b-db9d-41c4-9b15-57f41b6e2de2 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:52.550770 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:52.551174 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.640203 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:52.701864 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:52.702241 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.794893 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:52.820586 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:52.825942 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:53.020578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:53.506909 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1eb46b-a544-4c2c-a09c-17615112e934 req-d9e28d05-b7c2-405f-90ab-970046726308 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:53.514992 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf1eb46b-a544-4c2c-a09c-17615112e934 req-d9e28d05-b7c2-405f-90ab-970046726308 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0704312 Dec 14 03:16:53.576412 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf1eb46b-a544-4c2c-a09c-17615112e934 req-dcbbc7b9-0dcd-4e8b-b29f-7b21c73e430d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544381 Dec 14 03:16:53.588872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:53.863847 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Sync routers for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:16:53.878282 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:53.879069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:54.046691 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:54.278249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:50Z', 'revision_number': 4, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'd126ebc8-c629-45a9-8fa9-12005408d041', 'name': '', 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'mac_address': 'fa:16:3e:ec:d9:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_interface', 'standard_attr_id': 347, 'fixed_ips': [{'subnet_id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:50Z', 'updated_at': '2021-12-14T03:16:51Z', 'revision_number': 2, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'subnets': [{'id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:54.305091 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Checking router: 43a3da57-3840-4a67-8a18-1714364c5636 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:16:54.305320 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Updating router 43a3da57-3840-4a67-8a18-1714364c5636 port d126ebc8-c629-45a9-8fa9-12005408d041 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:16:54.330563 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.482224 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:54.591506 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.639749 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:54.640227 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.741572 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e2bf62-a2d6-40b4-a557-f7868800a713 req-defc954f-a259-4d51-8dba-61c4f0d47299 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:54.743213 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c7e2bf62-a2d6-40b4-a557-f7868800a713 req-defc954f-a259-4d51-8dba-61c4f0d47299 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0668981 Dec 14 03:16:54.751124 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.790078 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.823088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c7e2bf62-a2d6-40b4-a557-f7868800a713 req-d38643ef-1c43-4cd0-b237-7d01e563eb6d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693474 Dec 14 03:16:54.863540 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9b6f93-b9ff-4ab7-9c69-1e56f11d3131 None None] Pushing event updated for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:54.954302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Attempting to bind port d126ebc8-c629-45a9-8fa9-12005408d041 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:16:54.954942 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Attempting to bind port d126ebc8-c629-45a9-8fa9-12005408d041 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:16:54.955557 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Attempting to bind port d126ebc8-c629-45a9-8fa9-12005408d041 on network fff3dc45-7393-4a44-8e77-f9ec683d1be8 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:16:54.961744 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:16:54.962123 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Checking segment: {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:16:54.962643 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:54.963076 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Bound using segment: {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:16:54.963548 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Bound port: d126ebc8-c629-45a9-8fa9-12005408d041, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43ae2319-fd15-465f-bef2-747b3e5bb2be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 281, 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:16:54.963933 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.043500 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] For port d126ebc8-c629-45a9-8fa9-12005408d041, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:16:55.047921 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] For port d126ebc8-c629-45a9-8fa9-12005408d041, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d126ebc8-c629-45a9-8fa9-12005408d041,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:16:55.053401 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.154333 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:16:55.154961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:16:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:55.162149 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9b6f93-b9ff-4ab7-9c69-1e56f11d3131 None None] Pushing event updated for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:55.225274 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] Provisioning complete for port d126ebc8-c629-45a9-8fa9-12005408d041 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:55.225274 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.337008 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:16:55.452581 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.559785 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] For port d126ebc8-c629-45a9-8fa9-12005408d041, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d126ebc8-c629-45a9-8fa9-12005408d041,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:16:55.580580 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.722489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904455a4-c4ca-4169-8192-9d3c1a7088d0 None None] Pushing event updated for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:16:55.736926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-2fef7998-5f80-4508-83d0-bc41ab7d4738 None None] Provisioning complete for port d126ebc8-c629-45a9-8fa9-12005408d041 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:55.737295 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fef7998-5f80-4508-83d0-bc41ab7d4738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.911500 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:50Z', 'revision_number': 4, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'd126ebc8-c629-45a9-8fa9-12005408d041', 'name': '', 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'mac_address': 'fa:16:3e:ec:d9:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_interface', 'standard_attr_id': 347, 'fixed_ips': [{'subnet_id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:50Z', 'updated_at': '2021-12-14T03:16:55Z', 'revision_number': 4, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'subnets': [{'id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:16:55.953041 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc8177a-2cc8-4205-84fd-278173c07b88 None None] The sync data for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi is: [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:50Z', 'revision_number': 4, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'd126ebc8-c629-45a9-8fa9-12005408d041', 'name': '', 'network_id': 'fff3dc45-7393-4a44-8e77-f9ec683d1be8', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'mac_address': 'fa:16:3e:ec:d9:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_interface', 'standard_attr_id': 347, 'fixed_ips': [{'subnet_id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:50Z', 'updated_at': '2021-12-14T03:16:55Z', 'revision_number': 4, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'subnets': [{'id': '49905273-bd25-4b7d-ac4b-f22b00cfcd1a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:16:55.960779 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:55.982154 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3757fd2-51a2-4724-aed4-72a374188184 req-62dafe86-2bf3-4b7d-81f3-65ecf7c7d747 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:56.023889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3757fd2-51a2-4724-aed4-72a374188184 req-62dafe86-2bf3-4b7d-81f3-65ecf7c7d747 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1210251 Dec 14 03:16:56.123107 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3757fd2-51a2-4724-aed4-72a374188184 req-aba22bda-f743-45b3-b3de-1639595d5bb8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899384 Dec 14 03:16:56.468978 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d126ebc8-c629-45a9-8fa9-12005408d041 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:16:56.537883 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port d126ebc8-c629-45a9-8fa9-12005408d041 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:16:56.538283 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:16:57.251758 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b req-0ea16bee-59a7-4001-bb25-7067665d33c1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:57.259968 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b req-0ea16bee-59a7-4001-bb25-7067665d33c1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0643594 Dec 14 03:16:57.354295 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b req-979eb37e-1f44-48a7-9c32-277926d871c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793650 Dec 14 03:16:58.506539 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b req-aef01a8f-8e00-45e0-9047-535fea22cf77 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:58.509135 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b req-aef01a8f-8e00-45e0-9047-535fea22cf77 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0603156 Dec 14 03:16:58.585973 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b req-2d737452-93b2-451b-a16a-3807b08cd507 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654523 Dec 14 03:16:59.755564 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 req-286b7984-5044-4535-a653-3c72c752c4e1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:16:59.762634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 req-286b7984-5044-4535-a653-3c72c752c4e1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0557303 Dec 14 03:16:59.817717 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 req-b9935794-cae4-401f-8125-e76ae01a5c8f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539441 Dec 14 03:17:00.138210 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-6eb7a41d-4662-4e28-8c31-36396ad77ad1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:00.140384 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-6eb7a41d-4662-4e28-8c31-36396ad77ad1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.3314912 Dec 14 03:17:00.169618 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-5d76c117-1dd9-4747-a732-00694f6b99c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/quotas/7ecea5c13a624ab8a3a445d3ede5fd77 HTTP/1.1" status: 200 len: 375 time: 0.0183895 Dec 14 03:17:00.228178 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-557101ba-0a2e-4ddf-bfd5-0372a12ffb42 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0525029 Dec 14 03:17:00.346904 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-b1781e63-d1eb-4f50-b9f4-51239cd27132 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113729 Dec 14 03:17:00.458382 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-502f2df8-0be4-4119-ad86-0ee74d0c94d9 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1102989 Dec 14 03:17:00.712136 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-98b25de1-52e3-41b5-b5a7-e0bfbfcfbba0 req-0f82a7c0-a868-4121-aa40-7233a8feecfe tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0726645 Dec 14 03:17:00.987393 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 req-0ef238e5-4115-4841-9f46-e1135cb269dc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:00.994312 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 req-0ef238e5-4115-4841-9f46-e1135cb269dc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0699861 Dec 14 03:17:01.059933 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 req-c36a3add-8680-4af3-9f1e-753aae814db8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589063 Dec 14 03:17:01.813934 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 req-9542271e-ec54-4988-9ae1-c0f7e1b21879 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0277817 Dec 14 03:17:02.144652 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-8e6f9280-334c-4633-b268-6601162d8b3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:02.146051 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-8e6f9280-334c-4633-b268-6601162d8b3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1765587 Dec 14 03:17:02.217447 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 req-03463638-3770-4d2e-aea0-0986c8716fcf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:02.219059 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 req-03463638-3770-4d2e-aea0-0986c8716fcf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0604606 Dec 14 03:17:02.276769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 req-3af1b981-01b0-4443-81ad-9981d24bc84f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506353 Dec 14 03:17:02.548152 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Request body: {'port': {'device_id': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'admin_state_up': True, 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:17:02.715305 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:17:02.718807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:02.851004 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Allocated IP 172.20.0.5 (69a3889e-636a-4983-9398-edafd7db5301/5cfcc7bf-6dc9-4045-a09c-867974704f94/9ffbafb8-f71a-4067-8988-a284fbb41603) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:17:02.998674 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:03.032429 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:03.075543 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Network 69a3889e-636a-4983-9398-edafd7db5301 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:17:03.078679 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:17:03.082466 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:17:03.123633 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event updated for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:03.143097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:03.143328 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:03.165878 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d804c3e7-4bf2-42a2-9477-16056088661c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6226847 Dec 14 03:17:03.204257 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69d7d56-c422-4c1e-8fbd-2022438eecef req-719df228-45ad-4ada-84fb-166202409abf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:03.205676 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b69d7d56-c422-4c1e-8fbd-2022438eecef req-719df228-45ad-4ada-84fb-166202409abf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 931 time: 0.0465832 Dec 14 03:17:03.251313 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b69d7d56-c422-4c1e-8fbd-2022438eecef req-ea500bd3-540e-47f9-bcb2-f5dd858a8050 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397115 Dec 14 03:17:03.422678 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-3cdfd139-62c7-4d0d-95df-e7184e67b704 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:03.424068 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-3cdfd139-62c7-4d0d-95df-e7184e67b704 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 814 time: 0.1029890 Dec 14 03:17:03.438927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-43e09ef0-ba52-4112-83bc-2e20f38bb325 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/quotas/bc2e5ee76edf4e358f418773bf824ed7 HTTP/1.1" status: 200 len: 375 time: 0.0086501 Dec 14 03:17:03.487664 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-f512bee8-21b2-4627-915e-85d974a3a8c1 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0424275 Dec 14 03:17:03.579575 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-48cff7c8-d4de-4259-9178-462d745fbff8 service neutron] 10.222.0.43 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786669 Dec 14 03:17:03.668030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4b2a438d-7d80-453f-be01-cf9c45f82dc1 service neutron] 10.222.0.43 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825694 Dec 14 03:17:03.851840 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa855312-c33e-403d-bd7d-a25e2c953957 req-3594d48e-84c2-4232-afb1-fcd597a0edf5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:03.853354 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa855312-c33e-403d-bd7d-a25e2c953957 req-3594d48e-84c2-4232-afb1-fcd597a0edf5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0483527 Dec 14 03:17:03.902168 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa855312-c33e-403d-bd7d-a25e2c953957 req-e8e4d851-0de6-4e80-95c1-146d09f573ac tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410833 Dec 14 03:17:06.849550 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:17:06.888201 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Request body: {'port': {'device_id': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:17:06.963839 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.025905 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b655387-82b3-40db-be13-cb9acffa7e9a req-b4a76ea7-6b66-479c-bb26-d8e467ec0654 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:07.027595 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5b655387-82b3-40db-be13-cb9acffa7e9a req-b4a76ea7-6b66-479c-bb26-d8e467ec0654 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0501366 Dec 14 03:17:07.113497 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0e0fad83-6332-4127-bd75-9621297ccc9e req-7776789e-238e-45a9-8014-5733985e25a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 210 time: 0.0356534 Dec 14 03:17:07.126099 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5b655387-82b3-40db-be13-cb9acffa7e9a req-11797edc-0d8b-4e7a-976a-dfc9ed55a777 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765333 Dec 14 03:17:07.167252 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b72a95-757b-4751-83d7-e69e7ab191b5 req-3169b9c4-6c02-49de-bc32-384517e8e0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:07.169105 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0b72a95-757b-4751-83d7-e69e7ab191b5 req-3169b9c4-6c02-49de-bc32-384517e8e0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 931 time: 0.0547264 Dec 14 03:17:07.267799 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 req-37addbbf-d681-4ed4-bc96-1c8e6c727e0b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:07.269739 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 req-37addbbf-d681-4ed4-bc96-1c8e6c727e0b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0844841 Dec 14 03:17:07.271061 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ffbafb8-f71a-4067-8988-a284fbb41603 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:17:07.273266 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0b72a95-757b-4751-83d7-e69e7ab191b5 req-c20fc463-12bf-48b3-96ec-2b1e15c87ca1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891833 Dec 14 03:17:07.278933 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.297282 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Transition to ACTIVE for port object 9ffbafb8-f71a-4067-8988-a284fbb41603 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:17:07.301973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.318753 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 req-3123ae15-cbe4-44b7-9372-206e3c28f687 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428641 Dec 14 03:17:07.615799 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Pushing event updated for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:07.672286 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Attempting to bind port 9ffbafb8-f71a-4067-8988-a284fbb41603 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:17:07.672617 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Attempting to bind port 9ffbafb8-f71a-4067-8988-a284fbb41603 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:17:07.672935 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Attempting to bind port 9ffbafb8-f71a-4067-8988-a284fbb41603 on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:17:07.677090 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Port 9ffbafb8-f71a-4067-8988-a284fbb41603 on network 69a3889e-636a-4983-9398-edafd7db5301 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:17:07.677404 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Attempting to bind port 9ffbafb8-f71a-4067-8988-a284fbb41603 on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:17:07.682059 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:17:07.682385 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Checking segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:17:07.682759 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Bound using segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:17:07.683205 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Bound port: 9ffbafb8-f71a-4067-8988-a284fbb41603, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:17:07.683557 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.745097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:17:07.747981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9ffbafb8-f71a-4067-8988-a284fbb41603,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:17:07.752575 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.787995 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:07.788602 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:07.789936 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] 10.222.0.20 "PUT /v2.0/ports/9ffbafb8-f71a-4067-8988-a284fbb41603 HTTP/1.1" status: 200 len: 1093 time: 0.9071505 Dec 14 03:17:07.790388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:17:07.792621 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f" -d '{"events": [{"name": "network-changed", "server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:17:07.812321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9651ab-f2bd-40f3-8f95-3fcf4cf64dbf service neutron] Pushing event updated for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:07.833656 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:17:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca7b792f-482a-4a74-bc52-394d41fccadd x-openstack-request-id: req-ca7b792f-482a-4a74-bc52-394d41fccadd {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:17:07.833951 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:17:07.834207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ca7b792f-482a-4a74-bc52-394d41fccadd {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:17:07.834606 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603', 'status': 'completed', 'code': 200} Dec 14 03:17:08.242469 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-70e8e872-838e-4c08-a9c9-52a060b08f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.244223 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-70e8e872-838e-4c08-a9c9-52a060b08f3b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 1096 time: 0.0437577 Dec 14 03:17:08.434733 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c740ccb4-7717-4267-b089-aff8024cd538 req-0169d341-9aff-47ce-8d9e-89226944d93c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 210 time: 0.0286512 Dec 14 03:17:08.460827 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-043c0507-2a00-41f3-81b0-375200450349 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.462361 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-043c0507-2a00-41f3-81b0-375200450349 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1062930 Dec 14 03:17:08.528904 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41e6769-0502-4b9e-baf6-560f70f35adb req-01499b81-b2e9-4124-8243-ccb86cc003a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.530351 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c41e6769-0502-4b9e-baf6-560f70f35adb req-01499b81-b2e9-4124-8243-ccb86cc003a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 943 time: 0.0761769 Dec 14 03:17:08.559400 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-b6e17ece-04a9-4aca-80c1-a6b4c3578011 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.561188 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-b6e17ece-04a9-4aca-80c1-a6b4c3578011 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0907810 Dec 14 03:17:08.561816 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2c218a-5767-4ac0-8621-7828637f399b req-8c787e0c-ca20-4168-88b7-cb1e65dff9b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.563253 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-df2c218a-5767-4ac0-8621-7828637f399b req-8c787e0c-ca20-4168-88b7-cb1e65dff9b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0716562 Dec 14 03:17:08.605254 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c41e6769-0502-4b9e-baf6-560f70f35adb req-362756fb-80d1-4177-b7b6-13e8197bf606 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667386 Dec 14 03:17:08.627569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-df2c218a-5767-4ac0-8621-7828637f399b req-2b1851f0-1998-4be3-a246-45caf092cfce tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584404 Dec 14 03:17:08.819482 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-a884e4a6-2c54-4ac3-a50c-29d60b685f5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.820926 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-a884e4a6-2c54-4ac3-a50c-29d60b685f5b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 1096 time: 0.0405133 Dec 14 03:17:08.875794 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d011abc0-6d63-47ab-a3ca-967f2cdb8c11 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=9ffbafb8-f71a-4067-8988-a284fbb41603 HTTP/1.1" status: 200 len: 217 time: 0.0382931 Dec 14 03:17:08.924913 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d3e53a38-3bfc-4413-8aed-da58e1cfc480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:08.926339 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d3e53a38-3bfc-4413-8aed-da58e1cfc480 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0426371 Dec 14 03:17:08.960146 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-90e96d09-0fe2-407e-9dec-453d5ff88626 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250340 Dec 14 03:17:09.054022 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-d0035ad5-a0c5-45a2-892f-8a48d5a6c7cd service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838649 Dec 14 03:17:09.143710 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 req-f79ee89c-fad3-4228-b60c-5d8059d7d335 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813334 Dec 14 03:17:09.264859 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-73d5f912-afca-4a17-bc7c-4860a95c0858 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:09.266363 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-73d5f912-afca-4a17-bc7c-4860a95c0858 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 814 time: 0.1039207 Dec 14 03:17:09.323494 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'port': {'device_id': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'admin_state_up': True, 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:17:09.475906 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Made reservation on behalf of bc2e5ee76edf4e358f418773bf824ed7 for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:17:09.480408 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.607896 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Allocated IP 172.20.0.14 (f2ccc364-1044-4d86-92a1-159741b0fffd/4b4783ac-1363-4237-9ce6-75efb61eaefb/bb3c28d2-c03d-4924-8dd8-da975e5427e4) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:17:09.614681 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52216) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:09.724291 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9ba28282-57cd-49bd-be55-c9ec30dc4b17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.756370 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.792661 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.810696 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9ba28282-57cd-49bd-be55-c9ec30dc4b17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.814680 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9ba28282-57cd-49bd-be55-c9ec30dc4b17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.844237 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Network f2ccc364-1044-4d86-92a1-159741b0fffd is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:17:09.848042 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:17:09.851652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:17:09.851949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba28282-57cd-49bd-be55-c9ec30dc4b17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59391ce2-1a88-4e19-86a8-ff493d19f79b,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:09.856609 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9ba28282-57cd-49bd-be55-c9ec30dc4b17 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=88a6d9c2f5a940de9042e2c036cfb855&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2407568 Dec 14 03:17:09.857449 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:09.858150 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.860072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52224) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:09.867721 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:09.883028 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4e468c5f-d67d-4d29-a7bb-43f933a9f49c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5650263 Dec 14 03:17:09.927875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.967966 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:09.998227 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Request body: {'port': {'device_id': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:17:10.036900 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.040383 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.044567 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/59391ce2-1a88-4e19-86a8-ff493d19f79b HTTP/1.1" status: 204 len: 168 time: 0.1805744 Dec 14 03:17:10.053053 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bccedcf6-bd78-4fde-932a-fc82662d6bf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59391ce2-1a88-4e19-86a8-ff493d19f79b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:10.190779 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c569fc-57b0-44e9-9336-017f8e665474 req-ed0c6d71-fea5-4c01-a8b6-4a90d2e9e2e2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:10.196081 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-7d2f6314-faa5-494e-8b87-70014e4d0fde None None] Provisioning complete for port bb3c28d2-c03d-4924-8dd8-da975e5427e4 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:17:10.198104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96c569fc-57b0-44e9-9336-017f8e665474 req-ed0c6d71-fea5-4c01-a8b6-4a90d2e9e2e2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 932 time: 0.2354724 Dec 14 03:17:10.198941 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7d2f6314-faa5-494e-8b87-70014e4d0fde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.206448 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.253316 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-7d2f6314-faa5-494e-8b87-70014e4d0fde None None] Port bb3c28d2-c03d-4924-8dd8-da975e5427e4 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:17:10.254630 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e718d0-b642-46d1-be07-5b24633a87f2 req-e586d25d-9ce9-42ed-8d82-aa9a076d7119 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:10.260732 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-54e718d0-b642-46d1-be07-5b24633a87f2 req-e586d25d-9ce9-42ed-8d82-aa9a076d7119 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 943 time: 0.1673708 Dec 14 03:17:10.355418 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96c569fc-57b0-44e9-9336-017f8e665474 req-1b14f11d-0bb4-4936-b6c2-527482d0b112 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431727 Dec 14 03:17:10.489496 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-54e718d0-b642-46d1-be07-5b24633a87f2 req-28c7198d-6224-4af5-8581-7456e5972156 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2007346 Dec 14 03:17:10.537818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676f2a29-8f04-48fb-933d-9219143e47be req-0536b084-5a55-440e-ace6-0a1ea0e29340 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:10.539578 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-676f2a29-8f04-48fb-933d-9219143e47be req-0536b084-5a55-440e-ace6-0a1ea0e29340 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0959494 Dec 14 03:17:10.738323 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb3c28d2-c03d-4924-8dd8-da975e5427e4 {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:17:10.750676 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.779287 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Transition to ACTIVE for port object bb3c28d2-c03d-4924-8dd8-da975e5427e4 will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:17:10.783453 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-676f2a29-8f04-48fb-933d-9219143e47be req-8136dcc1-7ad9-4922-a654-fde7923a510e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680621 Dec 14 03:17:10.784794 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:10.876660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:10.917364 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Attempting to bind port bb3c28d2-c03d-4924-8dd8-da975e5427e4 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:17:10.917730 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Attempting to bind port bb3c28d2-c03d-4924-8dd8-da975e5427e4 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:17:10.921095 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Attempting to bind port bb3c28d2-c03d-4924-8dd8-da975e5427e4 on network f2ccc364-1044-4d86-92a1-159741b0fffd {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:17:10.924040 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Port bb3c28d2-c03d-4924-8dd8-da975e5427e4 on network f2ccc364-1044-4d86-92a1-159741b0fffd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:17:10.924638 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Attempting to bind port bb3c28d2-c03d-4924-8dd8-da975e5427e4 on network f2ccc364-1044-4d86-92a1-159741b0fffd {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:17:10.931328 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 16, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:17:10.931745 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Checking segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:17:10.932198 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Bound using segment: {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:17:10.932750 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Bound port: bb3c28d2-c03d-4924-8dd8-da975e5427e4, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 251, 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:17:10.933173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:11.027893 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:17:11.032236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:17:11.044509 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:11.101853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:11.102467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:11.104098 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] 10.222.0.20 "PUT /v2.0/ports/bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 1094 time: 1.1121144 Dec 14 03:17:11.104489 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:17:11.106974 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b512709-3c3d-4643-9a18-68c45d013fe9" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:17:11.128557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56204e00-705b-4890-993b-e8f31da8ee33 service neutron] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:11.194168 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.228482 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52292) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:14.334897 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5bb19c9b-4969-46a0-b083-a4869fe9c5c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.407348 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5bb19c9b-4969-46a0-b083-a4869fe9c5c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.411862 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5bb19c9b-4969-46a0-b083-a4869fe9c5c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.451867 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5bb19c9b-4969-46a0-b083-a4869fe9c5c2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8f0f7e74982140f2a2047ce729262110&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2222500 Dec 14 03:17:14.452724 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb19c9b-4969-46a0-b083-a4869fe9c5c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae5dde55-e1c9-430d-be71-87abc4e132e7,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:14.454542 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 52298) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:14.512842 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.536457 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.585313 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.587944 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:14.589080 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ae5dde55-e1c9-430d-be71-87abc4e132e7 HTTP/1.1" status: 204 len: 168 time: 0.1334345 Dec 14 03:17:14.597524 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b14e2b3-f475-48d3-bed9-07e5ecced819 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae5dde55-e1c9-430d-be71-87abc4e132e7,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:19.149484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 52354) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:19.262573 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6ee96e12-db6a-4ad0-b6d2-3fb4ea4b8ef3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.335103 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6ee96e12-db6a-4ad0-b6d2-3fb4ea4b8ef3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.339807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6ee96e12-db6a-4ad0-b6d2-3fb4ea4b8ef3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.377230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6ee96e12-db6a-4ad0-b6d2-3fb4ea4b8ef3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7a48a5d61c7344a9ae7f8d387cf5da5e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2266960 Dec 14 03:17:19.379746 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee96e12-db6a-4ad0-b6d2-3fb4ea4b8ef3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ea76403-5464-4fac-b4ef-1efee154338a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:19.380577 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52358) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:19.430971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.457356 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.508639 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.511274 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:19.512394 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8ea76403-5464-4fac-b4ef-1efee154338a HTTP/1.1" status: 204 len: 168 time: 0.1308343 Dec 14 03:17:19.522023 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685ef456-0538-491b-a7b9-cfba4f35cb82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ea76403-5464-4fac-b4ef-1efee154338a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:19.694596 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-30d092f3-22ee-4971-8226-929b5333f9ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:21.853980 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-28eeb7dc-fe47-4d3e-b1e8-3c25b03604af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:23.572393 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:24.549888 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:25.783219 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:27.999397 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:17:29.749493 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4a27d305-7c75-4f63-b143-b33c5ecd0dc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:29.750854 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-4a27d305-7c75-4f63-b143-b33c5ecd0dc8 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1097 time: 0.0391865 Dec 14 03:17:29.982284 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:17:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 x-openstack-request-id: req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:17:29.982532 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:17:29.982787 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:17:29.983349 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:17:29.993939 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-09aa3755-0392-47b9-af6a-095d794b75d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:29.996171 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-09aa3755-0392-47b9-af6a-095d794b75d2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0441897 Dec 14 03:17:30.018711 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-ba8adde9-9fc1-4ec3-9b20-f055d718a8cd service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 217 time: 0.0594730 Dec 14 03:17:30.088103 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 req-1809b75e-3f20-424b-ad9a-117a8da10b86 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.089560 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 req-1809b75e-3f20-424b-ad9a-117a8da10b86 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1429060 Dec 14 03:17:30.092588 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-ee50a5a5-5e5a-4846-b8e6-d95513850062 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.094024 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-ee50a5a5-5e5a-4846-b8e6-d95513850062 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.0884533 Dec 14 03:17:30.121594 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-8a66d848-7d0c-4acc-8380-2348b9f35109 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.123153 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-8a66d848-7d0c-4acc-8380-2348b9f35109 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0965033 Dec 14 03:17:30.137565 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c07125d-9528-4779-b33b-e47834f2e226 req-0b5da888-ff30-4a64-9d83-3c77d525dd4c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.139250 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c07125d-9528-4779-b33b-e47834f2e226 req-0b5da888-ff30-4a64-9d83-3c77d525dd4c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.1155872 Dec 14 03:17:30.143723 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-1324b965-a90c-4774-8d3c-f715b6231fb5 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0361173 Dec 14 03:17:30.187973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-dc52f831-c8e0-4557-9c6d-f06a770aa4e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.189448 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-dc52f831-c8e0-4557-9c6d-f06a770aa4e0 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0444851 Dec 14 03:17:30.213542 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 req-6b8366d2-8c82-421c-b1ec-af97eb4334fa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161644 Dec 14 03:17:30.233023 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-aedafb21-fc40-4fc8-ad09-a0017deea747 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0303969 Dec 14 03:17:30.246206 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-dcb94eb6-e6e4-4246-b7f7-188da4032d09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.247712 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-dcb94eb6-e6e4-4246-b7f7-188da4032d09 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1022582 Dec 14 03:17:30.267728 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c07125d-9528-4779-b33b-e47834f2e226 req-e0d0b64f-8572-468e-a134-e398fbfffd90 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1210225 Dec 14 03:17:30.331079 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e719823f-7a3f-4fb9-8877-492127d70fc6 req-aadce70e-3638-4ab9-a467-3abe3fd1c224 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:30.332528 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e719823f-7a3f-4fb9-8877-492127d70fc6 req-aadce70e-3638-4ab9-a467-3abe3fd1c224 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 943 time: 0.0480180 Dec 14 03:17:30.332648 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-ede71d2b-99bd-424e-8fe3-bd9230e30b53 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0917356 Dec 14 03:17:30.379241 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e719823f-7a3f-4fb9-8877-492127d70fc6 req-97403810-83e9-4c24-bc3c-a106fd1aa98d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406852 Dec 14 03:17:34.679234 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e6514dee-6ad5-4976-9373-2743ff5d7024 req-bd40b711-83e1-4ea0-b7e4-cffa0f5fd073 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875468 Dec 14 03:17:34.688556 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-82907480-e54f-4e6c-8373-35254de06a14 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979159 Dec 14 03:17:34.990024 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a45706-9edb-4b4f-8b80-57e319201afe req-1d066d16-6aa0-439f-8d20-af9187a55134 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:34.991411 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-95a45706-9edb-4b4f-8b80-57e319201afe req-1d066d16-6aa0-439f-8d20-af9187a55134 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.3149521 Dec 14 03:17:35.043385 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c254d08-0032-461a-8bc4-445c2a5ed44c req-86a37f37-9e97-4081-ac6d-bb4081c5ddc5 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3393834 Dec 14 03:17:35.051443 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 req-2351e8e2-a472-47e9-92d0-6bdd2c754187 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.052806 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 req-2351e8e2-a472-47e9-92d0-6bdd2c754187 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.2948256 Dec 14 03:17:35.091541 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-95a45706-9edb-4b4f-8b80-57e319201afe req-bbe81417-4cc9-41ba-b58f-368e5b80045f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918813 Dec 14 03:17:35.119416 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 req-4b044025-8a3d-45d4-883c-b0521959f48f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573084 Dec 14 03:17:35.206176 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-15604381-b793-40ef-b6db-965cba8b0b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.207691 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-15604381-b793-40ef-b6db-965cba8b0b3a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1097 time: 0.0740843 Dec 14 03:17:35.218418 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8186321e-c2d4-4d95-83d5-76743183e547 req-cbe05b84-faa1-446b-801b-d6647e885e50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.219783 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8186321e-c2d4-4d95-83d5-76743183e547 req-cbe05b84-faa1-446b-801b-d6647e885e50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 943 time: 0.0592382 Dec 14 03:17:35.319184 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8186321e-c2d4-4d95-83d5-76743183e547 req-d89478a6-25cc-4475-8de7-e710228a8d57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0910373 Dec 14 03:17:35.335018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-4037b48a-791a-4ca5-8294-40d3358cd87f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.336460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-4037b48a-791a-4ca5-8294-40d3358cd87f service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.1158562 Dec 14 03:17:35.423080 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-dbe969b5-0ec4-4f03-9007-4d9ddab2e046 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 217 time: 0.0342612 Dec 14 03:17:35.478205 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-770218a1-a214-4eca-b712-6aa81ad30fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.479730 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-770218a1-a214-4eca-b712-6aa81ad30fe8 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0459867 Dec 14 03:17:35.535800 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-c4b47a5b-dffb-4470-95a0-b08e63862dc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:35.537466 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-c4b47a5b-dffb-4470-95a0-b08e63862dc0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0426531 Dec 14 03:17:35.803858 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-aca95770-d97e-4d78-9c06-19783c11ff36 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0903206 Dec 14 03:17:35.897939 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-a08d2a71-e0a2-4b90-9ea9-7d5c0e8a0caf service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839512 Dec 14 03:17:36.213784 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b509ee7-8914-4fa4-be1e-5e701699fc33 req-47374104-2554-4bd0-9e6f-8acd1810a0ff tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:36.215198 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b509ee7-8914-4fa4-be1e-5e701699fc33 req-47374104-2554-4bd0-9e6f-8acd1810a0ff tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0529120 Dec 14 03:17:36.262672 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b509ee7-8914-4fa4-be1e-5e701699fc33 req-f85a0aba-b1af-42de-a9af-3856bf57bd21 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415976 Dec 14 03:17:36.366708 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cc76cb-1279-469a-9ca1-5d191391d380 req-0a7afc16-d532-4731-a978-ff5dcdba251c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:36.368219 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-88cc76cb-1279-469a-9ca1-5d191391d380 req-0a7afc16-d532-4731-a978-ff5dcdba251c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.0509701 Dec 14 03:17:36.458012 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-88cc76cb-1279-469a-9ca1-5d191391d380 req-7d11a82f-58ac-4212-b5f3-81485891e148 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836971 Dec 14 03:17:36.473008 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 req-0d2bf611-5a6b-4fd1-918c-d5e9ded2777b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:36.474498 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 req-0d2bf611-5a6b-4fd1-918c-d5e9ded2777b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 943 time: 0.0834374 Dec 14 03:17:36.535581 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 req-4e5df871-4e5b-424d-946e-451b29a9ada0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542929 Dec 14 03:17:36.967360 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9ffbafb8-f71a-4067-8988-a284fbb41603 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:17:37.062874 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9ffbafb8-f71a-4067-8988-a284fbb41603,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:37.074787 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9ffbafb8-f71a-4067-8988-a284fbb41603', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'port_id': '9ffbafb8-f71a-4067-8988-a284fbb41603', 'mac_address': 'fa:16:3e:56:76:92', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 282, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cfcc7bf-6dc9-4045-a09c-867974704f94', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:17:37.110376 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:37.123995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ffbafb8-f71a-4067-8988-a284fbb41603 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:17:37.145111 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9ffbafb8-f71a-4067-8988-a284fbb41603,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:37.150620 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:37.212739 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:37.224244 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.224865 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.225532 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.226054 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.226386 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.227270 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.227666 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.228056 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.228467 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.228896 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.229267 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.229570 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.229966 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:37.381429 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca6079b-ec0c-49a9-b652-5ac820042c15 req-cb0673a8-241c-4e27-9f95-c73736721966 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:37.382959 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cca6079b-ec0c-49a9-b652-5ac820042c15 req-cb0673a8-241c-4e27-9f95-c73736721966 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0525672 Dec 14 03:17:37.429260 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cca6079b-ec0c-49a9-b652-5ac820042c15 req-89723059-7d11-497b-b0bb-71213006f3c6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403349 Dec 14 03:17:37.572934 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d req-fec5cd27-174d-4853-a3d1-d76b650f9454 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:37.574401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d req-fec5cd27-174d-4853-a3d1-d76b650f9454 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.0501943 Dec 14 03:17:37.649275 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d req-721f39b0-6f7d-4c96-ba77-167f97b5996b tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683782 Dec 14 03:17:37.671868 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 req-33879818-f737-4318-98a9-d244d96c3d91 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:37.676141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 req-33879818-f737-4318-98a9-d244d96c3d91 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 944 time: 0.0649228 Dec 14 03:17:37.722668 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 req-48e2c214-5152-4324-9056-766c13839d0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420830 Dec 14 03:17:37.890404 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52542) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:38.028874 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9ffbafb8-f71a-4067-8988-a284fbb41603'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:17:38.031784 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1add0379-fca2-42a3-8ffa-1ec937f95c5a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.133492 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1add0379-fca2-42a3-8ffa-1ec937f95c5a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.137141 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1add0379-fca2-42a3-8ffa-1ec937f95c5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.175249 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-1add0379-fca2-42a3-8ffa-1ec937f95c5a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7057ece3359645f0878e2bd79bf045ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2837174 Dec 14 03:17:38.176203 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1add0379-fca2-42a3-8ffa-1ec937f95c5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8954a787-7a08-40f7-8878-5256eb608266,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:38.177917 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 52554) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:38.224265 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.245772 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.290554 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.293171 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:38.294317 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8954a787-7a08-40f7-8878-5256eb608266 HTTP/1.1" status: 204 len: 168 time: 0.1153929 Dec 14 03:17:38.302352 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8954a787-7a08-40f7-8878-5256eb608266,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:38.309320 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.309669 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.310014 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.310350 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.310685 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.311012 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.311367 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.311699 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.312056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.312343 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.312668 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.312991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.313311 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263a3b4f-2562-474e-bfb8-a88de1acc6b9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:17:38.561479 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 req-fa539878-d636-4ffb-869b-274f0ae21f87 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:38.563032 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 req-fa539878-d636-4ffb-869b-274f0ae21f87 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0564404 Dec 14 03:17:38.609751 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 req-941f25fe-3f35-44ff-b2cf-f22924de57a0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402822 Dec 14 03:17:38.767226 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7396d73f-2157-4cab-bf22-b360d8ea5a7e req-cf6da0b3-36a1-44fa-8bda-495d707a9bee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:38.769392 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7396d73f-2157-4cab-bf22-b360d8ea5a7e req-cf6da0b3-36a1-44fa-8bda-495d707a9bee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.0489221 Dec 14 03:17:38.843899 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7396d73f-2157-4cab-bf22-b360d8ea5a7e req-0d2f4baf-9b88-4663-84ac-049515108357 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684612 Dec 14 03:17:38.863365 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72800299-8e89-4e46-8f9b-7127dd27d8d7 req-dcb87888-b4dc-4618-829d-48b7c65f9a54 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:38.864819 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72800299-8e89-4e46-8f9b-7127dd27d8d7 req-dcb87888-b4dc-4618-829d-48b7c65f9a54 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 944 time: 0.0703475 Dec 14 03:17:38.918582 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72800299-8e89-4e46-8f9b-7127dd27d8d7 req-e67f4b0d-b3a4-46a5-ac42-c09b251c98d4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477633 Dec 14 03:17:39.724928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 req-106f970c-2b95-48b2-8474-1ce7ea37e9da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:39.726322 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 req-106f970c-2b95-48b2-8474-1ce7ea37e9da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0490124 Dec 14 03:17:39.772579 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 req-a8cc6910-e2fe-4446-ad71-30be8c6e0cdf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404112 Dec 14 03:17:39.964893 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792818dd-6ea8-4c53-a06b-32762705d922 req-41c58bce-e52e-4fab-9c3a-8ac4e3f2dcf1 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:39.966365 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-792818dd-6ea8-4c53-a06b-32762705d922 req-41c58bce-e52e-4fab-9c3a-8ac4e3f2dcf1 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.0490367 Dec 14 03:17:40.057999 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-792818dd-6ea8-4c53-a06b-32762705d922 req-48cf3b94-6503-4b59-a499-99ebe6a93dff tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850728 Dec 14 03:17:40.077506 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd07e1f-581e-4909-b675-7fafb85d3841 req-cef11f95-ed37-4d96-89e9-b79cc052bcad tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:40.079749 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8dd07e1f-581e-4909-b675-7fafb85d3841 req-cef11f95-ed37-4d96-89e9-b79cc052bcad tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 944 time: 0.0802240 Dec 14 03:17:40.127359 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8dd07e1f-581e-4909-b675-7fafb85d3841 req-b1142d2c-e3c7-45f3-ab7d-2a07c51d5da4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418360 Dec 14 03:17:40.468175 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 52596) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:40.569487 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4c8dff34-2347-4ee3-9070-1ef28ab3cab0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.646323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4c8dff34-2347-4ee3-9070-1ef28ab3cab0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.650044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4c8dff34-2347-4ee3-9070-1ef28ab3cab0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.686768 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-4c8dff34-2347-4ee3-9070-1ef28ab3cab0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ee285a93d443472aa894db88321f757e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2175207 Dec 14 03:17:40.687985 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c8dff34-2347-4ee3-9070-1ef28ab3cab0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b84390a-f4cd-46d3-ba1b-162562a17f07,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:40.689981 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 52600) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:17:40.737595 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.758585 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.803335 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.805841 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:40.806953 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3b84390a-f4cd-46d3-ba1b-162562a17f07 HTTP/1.1" status: 204 len: 168 time: 0.1159389 Dec 14 03:17:40.816172 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053fa766-a59c-4ac3-8663-4196f82a9c73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b84390a-f4cd-46d3-ba1b-162562a17f07,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:40.992179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device bb3c28d2-c03d-4924-8dd8-da975e5427e4 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:17:41.003961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9ffbafb8-f71a-4067-8988-a284fbb41603 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:17:41.146789 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:41.162574 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'port_id': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'mac_address': 'fa:16:3e:fa:b0:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 251, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:17:41.167885 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 9ffbafb8-f71a-4067-8988-a284fbb41603 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:17:41.196779 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9ffbafb8-f71a-4067-8988-a284fbb41603 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:17:41.197155 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.230822 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de723c22-0f58-444b-b595-0782b84eb015 req-8ee12efe-f82a-49a3-b2de-1a2f692375ab tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:41.232631 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-de723c22-0f58-444b-b595-0782b84eb015 req-8ee12efe-f82a-49a3-b2de-1a2f692375ab tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 944 time: 0.0957961 Dec 14 03:17:41.245206 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.246793 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f req-f43c0770-b4a3-41c6-bba5-28b63932a8e3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:41.247357 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.248318 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f req-f43c0770-b4a3-41c6-bba5-28b63932a8e3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0692987 Dec 14 03:17:41.264873 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb3c28d2-c03d-4924-8dd8-da975e5427e4 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:17:41.290431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:41.317380 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.321969 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-de723c22-0f58-444b-b595-0782b84eb015 req-9b9241be-74a5-495e-8675-143a4f8235af tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726969 Dec 14 03:17:41.329942 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f req-549a8956-732a-4ba7-a6fe-c39caf435aa8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677941 Dec 14 03:17:41.364734 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.396778 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:41.425475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:17:41.429443 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0" -d '{"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-plugged", "status": "completed", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:17:41.446558 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9ffbafb8-f71a-4067-8988-a284fbb41603,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:41.452254 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:41.456314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9435e8df-6b06-459a-a803-2ee51e998f5e req-f284463f-a15f-499b-8a18-cbc1862c6a54 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:41.458397 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9435e8df-6b06-459a-a803-2ee51e998f5e req-f284463f-a15f-499b-8a18-cbc1862c6a54 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 944 time: 0.0577247 Dec 14 03:17:41.507096 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:41.521228 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9435e8df-6b06-459a-a803-2ee51e998f5e req-5c2f62ac-b0b7-431a-9bce-5ec86b941c2d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563207 Dec 14 03:17:41.566213 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:17:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-202be2a7-7cfe-413f-829c-336f43f75bf2 x-openstack-request-id: req-202be2a7-7cfe-413f-829c-336f43f75bf2 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:17:41.566526 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-plugged", "status": "completed", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:17:41.566762 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-202be2a7-7cfe-413f-829c-336f43f75bf2 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:17:41.567183 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603', 'code': 200} Dec 14 03:17:41.805914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c174553b-6ceb-4963-ab98-fac8a83637b3 req-d5209c22-5083-412d-9910-c3dc32676651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:41.807536 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c174553b-6ceb-4963-ab98-fac8a83637b3 req-d5209c22-5083-412d-9910-c3dc32676651 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 1098 time: 0.0460005 Dec 14 03:17:41.852653 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:17:41.898711 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c174553b-6ceb-4963-ab98-fac8a83637b3 req-04e38b5e-67ba-459c-98cd-3359bbec7af1 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626402 Dec 14 03:17:42.458197 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0427b81-0434-46b3-8893-66478c7f35a2 req-fde378ce-6906-4ef1-b412-92e3d6d500ed tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:42.459732 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c0427b81-0434-46b3-8893-66478c7f35a2 req-fde378ce-6906-4ef1-b412-92e3d6d500ed tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 945 time: 0.0481195 Dec 14 03:17:42.506818 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c0427b81-0434-46b3-8893-66478c7f35a2 req-c16c37c0-6970-4f57-ada3-a57284e50496 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413606 Dec 14 03:17:42.651447 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 req-778ef582-3ba2-4390-8340-4091069dc426 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:42.652791 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 req-778ef582-3ba2-4390-8340-4091069dc426 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0507903 Dec 14 03:17:42.699583 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 req-b9814f0f-a1f2-4191-9fc9-1e15b5ba2a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404954 Dec 14 03:17:43.385983 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-065cc548-c7ed-45c3-bf33-ae68c3e467a5 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0403957 Dec 14 03:17:43.476001 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360b906d-0127-4647-a05f-edc004dd6aed req-24541934-9baf-4513-9bff-10eee5105e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:43.478424 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-24541934-9baf-4513-9bff-10eee5105e72 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 1099 time: 0.0580540 Dec 14 03:17:43.649486 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360b906d-0127-4647-a05f-edc004dd6aed req-38790de8-a0cd-46e2-84b0-6f1475d48e17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:43.650960 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-38790de8-a0cd-46e2-84b0-6f1475d48e17 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1450312 Dec 14 03:17:43.660313 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecea7811-875f-40f5-9760-29073217eac2 req-65bd5f3f-c424-446a-ad1e-c4a6f9705608 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:43.661795 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ecea7811-875f-40f5-9760-29073217eac2 req-65bd5f3f-c424-446a-ad1e-c4a6f9705608 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 945 time: 0.0728443 Dec 14 03:17:43.705811 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-35f3ef9b-ae5d-44b4-8f07-cca832701bef service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 200 len: 217 time: 0.0425587 Dec 14 03:17:43.738824 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ecea7811-875f-40f5-9760-29073217eac2 req-792fd184-651b-44df-be23-42dbaa876851 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695181 Dec 14 03:17:43.870787 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d296f140-fc49-4b18-8c7a-00686ce3f581 req-79075968-536d-4a3e-a670-1c9a8cdd102e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:43.872305 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d296f140-fc49-4b18-8c7a-00686ce3f581 req-79075968-536d-4a3e-a670-1c9a8cdd102e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0802934 Dec 14 03:17:43.878446 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360b906d-0127-4647-a05f-edc004dd6aed req-f847f2e1-71f4-4974-885c-63c11a2d8736 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:43.879906 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-f847f2e1-71f4-4974-885c-63c11a2d8736 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0614469 Dec 14 03:17:43.921308 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d296f140-fc49-4b18-8c7a-00686ce3f581 req-d17f673e-b430-47db-b1cc-68bdb75122b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403953 Dec 14 03:17:43.956000 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-763aa412-a1fa-4174-97b5-2642ebee6a8b service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0270975 Dec 14 03:17:44.043523 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-2a75d4fd-33ea-4ef5-9738-fc45160cc558 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0791261 Dec 14 03:17:44.139182 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-360b906d-0127-4647-a05f-edc004dd6aed req-a9588d89-8216-413c-a055-19ba0a7a6aa7 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882931 Dec 14 03:17:44.850861 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd req-c6d2046e-90d1-4a3e-9567-3270a7dd3496 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:44.852376 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd req-c6d2046e-90d1-4a3e-9567-3270a7dd3496 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 945 time: 0.0490336 Dec 14 03:17:44.902337 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd req-a6d487b7-d15d-4193-92b9-6489ef40a58b tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408165 Dec 14 03:17:45.009488 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device bb3c28d2-c03d-4924-8dd8-da975e5427e4 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:17:45.051514 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2181ae3d-63b9-4d76-bada-c6a001c8d541 req-6891864c-f9e6-40e8-98b7-77d8f5edfbcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:45.053024 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2181ae3d-63b9-4d76-bada-c6a001c8d541 req-6891864c-f9e6-40e8-98b7-77d8f5edfbcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0530627 Dec 14 03:17:45.059749 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port bb3c28d2-c03d-4924-8dd8-da975e5427e4 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:17:45.064076 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port bb3c28d2-c03d-4924-8dd8-da975e5427e4 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:17:45.064459 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:45.100534 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2181ae3d-63b9-4d76-bada-c6a001c8d541 req-148c2284-2cd4-4cba-9bc5-45ddb6dae43f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409453 Dec 14 03:17:45.144403 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:45.167281 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:17:45.169603 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1" -d '{"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-plugged", "status": "completed", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:17:45.182482 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:17:45.187343 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:45.213058 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:17:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c17b7bc8-0778-4396-a92e-9a097d697575 x-openstack-request-id: req-c17b7bc8-0778-4396-a92e-9a097d697575 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:17:45.213380 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-plugged", "status": "completed", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:17:45.213635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c17b7bc8-0778-4396-a92e-9a097d697575 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:17:45.214017 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'code': 200} Dec 14 03:17:45.239828 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:17:45.435686 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7026ca-d4f7-4ef0-996b-fe742546ae23 req-9832a1b5-1a5d-44e1-a1b4-43abf9a6863e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:45.437188 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6f7026ca-d4f7-4ef0-996b-fe742546ae23 req-9832a1b5-1a5d-44e1-a1b4-43abf9a6863e service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1099 time: 0.0425372 Dec 14 03:17:45.483450 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6f7026ca-d4f7-4ef0-996b-fe742546ae23 req-d16d0f1d-f54f-41bd-9e7f-4cade0de0084 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376146 Dec 14 03:17:46.019026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 req-98876629-cf3e-49a8-8371-8df884f345d9 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:46.020565 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 req-98876629-cf3e-49a8-8371-8df884f345d9 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0487168 Dec 14 03:17:46.066628 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 req-2273ad6d-698f-4b7b-9249-73ecde8dbfa0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403469 Dec 14 03:17:47.186997 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52945f8b-0fcc-43df-a6dc-0778674fc06c req-7065f374-c997-4112-9241-c217b329d494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:47.188395 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-52945f8b-0fcc-43df-a6dc-0778674fc06c req-7065f374-c997-4112-9241-c217b329d494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0519574 Dec 14 03:17:47.234248 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-52945f8b-0fcc-43df-a6dc-0778674fc06c req-5775db64-12a1-4f09-a0ef-88236710642d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398817 Dec 14 03:17:48.354581 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 req-6d37bebe-e7a0-49fb-a682-0f91a2d637c0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:48.356220 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 req-6d37bebe-e7a0-49fb-a682-0f91a2d637c0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0504701 Dec 14 03:17:48.423102 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 req-f57e7fc2-2149-4eca-b9ff-f9c28c03c787 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475044 Dec 14 03:17:48.538600 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64308a4f-4435-4b87-b065-90fed29d3655 req-cccfd5f5-f556-4bed-90fb-c74817cdf9dd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:48.540086 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-64308a4f-4435-4b87-b065-90fed29d3655 req-cccfd5f5-f556-4bed-90fb-c74817cdf9dd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0474136 Dec 14 03:17:48.590800 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-64308a4f-4435-4b87-b065-90fed29d3655 req-a114f020-a411-4f4b-a80d-5d6af2f45582 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448580 Dec 14 03:17:48.908631 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 req-cc515899-39ee-4170-9149-47b9ec002a41 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:17:48.909979 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 req-cc515899-39ee-4170-9149-47b9ec002a41 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0474799 Dec 14 03:17:48.954869 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 req-f2763168-5967-4db1-9508-4db9404c9d9f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392153 Dec 14 03:17:49.657356 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-af7203a4-ccc1-4956-8e2f-1da21d8a2ae1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:51.856629 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5cdc42bb-2fbd-4b7c-a0d8-a3c2525272f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:53.572595 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:54.559878 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:17:55.786171 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:00.054377 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba2abe9-c777-4c7f-993e-4e4d556e841b req-c2ede544-6863-4852-a811-4e50f5e71ff7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:00.055926 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8ba2abe9-c777-4c7f-993e-4e4d556e841b req-c2ede544-6863-4852-a811-4e50f5e71ff7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0838969 Dec 14 03:18:00.084853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-6e0bbbf7-38d8-4943-9db6-e16c91222555 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:00.086337 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-6e0bbbf7-38d8-4943-9db6-e16c91222555 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0732560 Dec 14 03:18:00.164469 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8ba2abe9-c777-4c7f-993e-4e4d556e841b req-0fbf160c-d4e7-476f-9336-b89b9e6beed9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015458 Dec 14 03:18:00.210598 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-b57ed8d7-fc4e-44c6-8e6d-da892b58632d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:00.212122 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-b57ed8d7-fc4e-44c6-8e6d-da892b58632d service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1140182 Dec 14 03:18:00.295582 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-1277777d-45c5-4139-bbd9-81dd43174e4e service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0450649 Dec 14 03:18:00.360818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-be0c7263-7247-401a-baad-0157eafd46d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:00.362521 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-be0c7263-7247-401a-baad-0157eafd46d9 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0578756 Dec 14 03:18:00.404884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-da2a7eaf-d596-4317-96aa-859283dfbd13 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333917 Dec 14 03:18:00.539157 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-163e80ee-2107-44cd-8d35-8307ef3c8ff2 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223190 Dec 14 03:18:00.673632 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-008f40bc-3cb5-49cb-a50e-15d11c19af08 req-8db3b424-58ba-4e46-942c-ad9aa673ebcb service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910280 Dec 14 03:18:01.282830 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac0077a-6096-4348-b888-7eb8e1e568bf req-3add21e7-0f83-438a-acb8-0f2366037fb8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:01.284406 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7ac0077a-6096-4348-b888-7eb8e1e568bf req-3add21e7-0f83-438a-acb8-0f2366037fb8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0468442 Dec 14 03:18:01.330215 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7ac0077a-6096-4348-b888-7eb8e1e568bf req-2dfa7512-3b2a-4443-8ff2-7875c06e44c0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400789 Dec 14 03:18:01.989681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-a1fa6293-16d0-40f6-ae4f-9ccc7a1e44d2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:01.991276 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-a1fa6293-16d0-40f6-ae4f-9ccc7a1e44d2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1041863 Dec 14 03:18:02.007230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-bd60fd5a-ec94-484e-99c6-8ab415793663 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/quotas/7ecea5c13a624ab8a3a445d3ede5fd77 HTTP/1.1" status: 200 len: 375 time: 0.0101855 Dec 14 03:18:02.057355 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4a1bda2e-7e48-43a1-a7f0-4cdb83ce6b73 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0447633 Dec 14 03:18:02.149068 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-706e15e2-e0f9-440e-89aa-0724f88acee6 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842168 Dec 14 03:18:02.235435 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-7f90008f-e40c-40dd-bee5-6c21f8682598 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795374 Dec 14 03:18:02.399158 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12d7d3a2-83ec-4b81-9de0-a5d596abec92 req-40b20906-9f0a-419e-9297-c3e22fd55aa3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 210 time: 0.0334382 Dec 14 03:18:02.472392 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1723f90-86c4-4db4-86f4-c58d61ca729c req-1a3476eb-057c-4847-8dc7-061e943f1a34 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:02.473873 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1723f90-86c4-4db4-86f4-c58d61ca729c req-1a3476eb-057c-4847-8dc7-061e943f1a34 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0630851 Dec 14 03:18:02.524302 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1723f90-86c4-4db4-86f4-c58d61ca729c req-d32114f4-fce7-4494-8159-88542295e2ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440769 Dec 14 03:18:03.494700 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-661876e5-f24f-44e4-a32e-f70534296b9a req-188eb482-0c89-4244-ad8f-ae8317aa85d9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 210 time: 0.0258751 Dec 14 03:18:03.639595 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d75af0-4236-4f7b-a603-47d0d02a2adc req-17da9d50-48e6-4054-af1e-cafffd0d9a13 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:03.641034 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-24d75af0-4236-4f7b-a603-47d0d02a2adc req-17da9d50-48e6-4054-af1e-cafffd0d9a13 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0470881 Dec 14 03:18:03.691339 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-24d75af0-4236-4f7b-a603-47d0d02a2adc req-95cd5d8a-27b9-4ac7-9133-0fb3f2a3f855 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442410 Dec 14 03:18:03.959019 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-fe2fb599-941d-4d80-a148-fdfd399234c1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:03.960709 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-fe2fb599-941d-4d80-a148-fdfd399234c1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1103690 Dec 14 03:18:04.031264 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Request body: {'port': {'device_id': '095d132d-1529-4a41-a033-a8b41a1af328', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'admin_state_up': True, 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:04.147504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:18:04.151091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:04.281486 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Allocated IP 172.20.0.11 (69a3889e-636a-4983-9398-edafd7db5301/5cfcc7bf-6dc9-4045-a09c-867974704f94/fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:18:04.607950 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e req-546078d4-f913-4f2b-be6a-07e499d1f33a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 210 time: 0.0323458 Dec 14 03:18:04.652921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:04.686485 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:04.735005 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Network 69a3889e-636a-4983-9398-edafd7db5301 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:18:04.741530 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:18:04.745886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:18:04.751647 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:04.751961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', '9ffbafb8-f71a-4067-8988-a284fbb41603'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:04.752472 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:04.760828 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event updated for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:04.778424 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-f82fbc55-a2bf-408f-8b63-26d588ecf3eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7500818 Dec 14 03:18:04.815156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Request body: {'port': {'device_id': '095d132d-1529-4a41-a033-a8b41a1af328', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:04.880620 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bc9167-acd1-4e8e-ae44-df069c671787 req-c79e8d58-3d61-4ca1-aaa8-b83f89350a31 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:04.882680 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-51bc9167-acd1-4e8e-ae44-df069c671787 req-c79e8d58-3d61-4ca1-aaa8-b83f89350a31 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1012068 Dec 14 03:18:04.887091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:04.985610 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-51bc9167-acd1-4e8e-ae44-df069c671787 req-b3f047b9-077c-49ad-a1d0-b47cbf940224 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895860 Dec 14 03:18:05.001744 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:18:05.191440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:18:05.198711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:05.211524 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Transition to ACTIVE for port object fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:18:05.215853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:05.267714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Pushing event updated for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:05.298811 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Attempting to bind port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:18:05.299079 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Attempting to bind port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:18:05.299420 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Attempting to bind port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:18:05.303687 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b on network 69a3889e-636a-4983-9398-edafd7db5301 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:18:05.304009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Attempting to bind port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:18:05.308731 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 17, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:18:05.309063 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Checking segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:18:05.309443 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Bound using segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:18:05.309869 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Bound port: fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:18:05.310220 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:05.379960 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:18:05.383733 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:18:05.388399 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:05.425596 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:05.426266 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:05.427703 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] 10.222.0.20 "PUT /v2.0/ports/fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b HTTP/1.1" status: 200 len: 1094 time: 0.6323891 Dec 14 03:18:05.428143 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:05.430360 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9cdae27d-3bab-46c8-86d3-b8598d404b38" -d '{"events": [{"name": "network-changed", "server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:05.450847 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cea250b-9063-45ae-b417-542958d7fa5d service neutron] Pushing event updated for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:05.469720 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed x-openstack-request-id: req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:05.470018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:05.470275 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:05.470673 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', 'status': 'completed', 'code': 200} Dec 14 03:18:05.561610 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-8ccb87e9-b636-43ba-9db6-762064b608cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:05.563133 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-8ccb87e9-b636-43ba-9db6-762064b608cd service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 1097 time: 0.0406921 Dec 14 03:18:05.628156 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-3636dd29-2b58-46a3-92aa-4f92bbdb390c service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b HTTP/1.1" status: 200 len: 217 time: 0.0347764 Dec 14 03:18:05.696140 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6892796-a5d1-490b-9d17-1883c54925fd req-a647b2f9-8a2f-4db9-836a-a9152540c45b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:05.697549 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-a647b2f9-8a2f-4db9-836a-a9152540c45b service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0614128 Dec 14 03:18:05.747001 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-6ec0b18d-bf50-41c6-bc20-a69dd784f484 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0284219 Dec 14 03:18:05.755267 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6634af6-1225-47fa-a04c-882452ca7f67 req-0c38ef0f-cae6-4ec2-a2e4-4df3bf18dae8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:05.756530 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d6634af6-1225-47fa-a04c-882452ca7f67 req-0c38ef0f-cae6-4ec2-a2e4-4df3bf18dae8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 944 time: 0.0747957 Dec 14 03:18:05.856244 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d6634af6-1225-47fa-a04c-882452ca7f67 req-a7c809b6-2648-439e-8b66-f086f5601129 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883758 Dec 14 03:18:05.879820 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-7687ecfd-0a15-442e-a0f7-8e425ca67951 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193140 Dec 14 03:18:05.971929 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e6892796-a5d1-490b-9d17-1883c54925fd req-a599c9ee-9e8c-4dcd-8a68-d056d681bb71 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829334 Dec 14 03:18:06.136645 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b650537-2ce1-433f-87b1-06ec8e99ec1a req-00bd22d9-be95-4f77-9044-c234c758b46c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:06.137997 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b650537-2ce1-433f-87b1-06ec8e99ec1a req-00bd22d9-be95-4f77-9044-c234c758b46c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0791099 Dec 14 03:18:06.146666 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-0d301522-620c-4b77-8f2c-cffa203a689e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:06.148052 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-0d301522-620c-4b77-8f2c-cffa203a689e service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 1097 time: 0.0571125 Dec 14 03:18:06.230510 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b650537-2ce1-433f-87b1-06ec8e99ec1a req-22bb02b3-49fd-44c5-b184-42ac66fcb553 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855901 Dec 14 03:18:06.274289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-154467e2-01f2-4d86-8abf-9e59ba21919a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:06.275796 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-154467e2-01f2-4d86-8abf-9e59ba21919a service neutron] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 916 time: 0.1044912 Dec 14 03:18:06.320992 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-b760f6c0-0f4c-4f98-a5a0-da6263ef2561 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b HTTP/1.1" status: 200 len: 217 time: 0.0341442 Dec 14 03:18:06.372399 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-1ae2e45b-9df8-474a-9bd6-b3669187d332 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:06.373888 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-1ae2e45b-9df8-474a-9bd6-b3669187d332 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0431359 Dec 14 03:18:06.417207 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-e4725afa-c026-4a33-98b7-165f63a2de0f service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262494 Dec 14 03:18:06.511220 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-c95b5149-d8b2-4917-9187-b3a769e96fe1 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859563 Dec 14 03:18:06.599278 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-a44ec210-03dd-459c-acad-d2b4d865d3d5 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806196 Dec 14 03:18:06.975610 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2163015e-ea7c-4695-b77b-1bb0a97b0051 req-7ba4e05b-7393-44a0-ba54-12cc635f9cef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:06.977084 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2163015e-ea7c-4695-b77b-1bb0a97b0051 req-7ba4e05b-7393-44a0-ba54-12cc635f9cef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 944 time: 0.0543320 Dec 14 03:18:07.024583 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2163015e-ea7c-4695-b77b-1bb0a97b0051 req-d257d89b-3cf0-40fa-81f8-ad579143ff2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416415 Dec 14 03:18:07.347096 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 req-cd1056a1-9d9a-44ca-ab80-475fd10c0be4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:07.348576 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 req-cd1056a1-9d9a-44ca-ab80-475fd10c0be4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0500772 Dec 14 03:18:07.397090 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 req-bf398cf4-8721-49bd-b3d2-b7baf38146bb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426598 Dec 14 03:18:08.138256 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff98b77-ac77-4267-8668-bd2effe5906f req-f3ec9be1-bcce-4f67-bb91-3a0c8887f2f8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:08.139674 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cff98b77-ac77-4267-8668-bd2effe5906f req-f3ec9be1-bcce-4f67-bb91-3a0c8887f2f8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 944 time: 0.0481846 Dec 14 03:18:08.189279 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cff98b77-ac77-4267-8668-bd2effe5906f req-41d01ad0-5aef-4699-ad35-3ec2261e9b0f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436826 Dec 14 03:18:08.512648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045f6be0-6450-4d86-906a-8a85c59a82e2 req-bcdec572-a765-4a02-9455-e788249df559 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:08.514132 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-045f6be0-6450-4d86-906a-8a85c59a82e2 req-bcdec572-a765-4a02-9455-e788249df559 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0513921 Dec 14 03:18:08.564431 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-045f6be0-6450-4d86-906a-8a85c59a82e2 req-125c3e4b-92ba-45e7-ab61-6bebf8ff317d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440111 Dec 14 03:18:09.106497 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:18:09.141344 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ee6906-0851-4960-b88b-dfd19850c030 req-ae8eabb6-79a4-48ca-a7e7-1573569961de tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:09.143309 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84ee6906-0851-4960-b88b-dfd19850c030 req-ae8eabb6-79a4-48ca-a7e7-1573569961de tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0501852 Dec 14 03:18:09.189969 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84ee6906-0851-4960-b88b-dfd19850c030 req-cd70457e-f25b-41e9-b841-16e2dbec8c5b tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403986 Dec 14 03:18:09.209839 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:09.212882 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53134) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:09.222526 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'port_id': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', 'mac_address': 'fa:16:3e:e0:8d:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 282, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cfcc7bf-6dc9-4045-a09c-867974704f94', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:18:09.259855 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.281562 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:18:09.302704 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:09.306992 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.312534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677dbf40-d04c-4509-a3b1-b9689fde3d6a req-9acd4a98-3723-4317-9ce8-e850656f4161 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:09.314760 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-677dbf40-d04c-4509-a3b1-b9689fde3d6a req-9acd4a98-3723-4317-9ce8-e850656f4161 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 944 time: 0.0555794 Dec 14 03:18:09.359334 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:09.373166 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-677dbf40-d04c-4509-a3b1-b9689fde3d6a req-b692f23a-e797-4b07-a20f-81e7791a6746 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510592 Dec 14 03:18:09.419522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae03244e-f7bd-4a55-89d9-64ac01d5b9f4 tempest-TestMinimumBasicScenario-1866080286 tempest-TestMinimumBasicScenario-1866080286-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:09.420944 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ae03244e-f7bd-4a55-89d9-64ac01d5b9f4 tempest-TestMinimumBasicScenario-1866080286 tempest-TestMinimumBasicScenario-1866080286-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1094 time: 0.2069619 Dec 14 03:18:09.424522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53138) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:09.428674 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'port_id': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:09.450080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for floatingip, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.545469 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.662522 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Allocated IP 172.27.3.143 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/eec32e42-0479-4a31-8d39-d995304b6cb2) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:18:09.689110 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91cbdb46-4abc-414c-8c56-7ef25c685f79 req-317725a5-333d-441e-91a2-78507feb3e9f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:09.690504 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91cbdb46-4abc-414c-8c56-7ef25c685f79 req-317725a5-333d-441e-91a2-78507feb3e9f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0538990 Dec 14 03:18:09.742890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91cbdb46-4abc-414c-8c56-7ef25c685f79 req-32bfcb2a-4648-449d-b4d4-26a561af5407 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462093 Dec 14 03:18:09.770014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.803888 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:09.843795 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:18:09.848747 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:18:09.852088 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:18:09.857296 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'Port': ['ID=eec32e42-0479-4a31-8d39-d995304b6cb2,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:09.885729 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.886082 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.886462 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.886811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.887188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.887524 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.887859 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.888191 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.888520 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.888850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.889179 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.889506 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.889833 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:09.931365 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:10.228672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.295948 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.445140 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.450028 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.499154 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da096e6f-1077-4f10-89c8-0e2311ec591b req-b3f432e8-7edb-462b-ae3b-e365c7e080c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:10.500635 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da096e6f-1077-4f10-89c8-0e2311ec591b req-b3f432e8-7edb-462b-ae3b-e365c7e080c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 945 time: 0.0550768 Dec 14 03:18:10.515981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'Port': ['ID=eec32e42-0479-4a31-8d39-d995304b6cb2,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:10.532508 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.547954 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da096e6f-1077-4f10-89c8-0e2311ec591b req-13ee0f8a-23a7-402e-bd5d-5a51663fbc53 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408032 Dec 14 03:18:10.634682 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Floating IP bd0e6ea6-d92a-472e-bfe1-9a23ceee8930 associated. External IP: 172.27.3.143, port: bb3c28d2-c03d-4924-8dd8-da975e5427e4. Dec 14 03:18:10.839233 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:18:10.855742 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 req-68561f08-56b1-4e80-9b02-9436fe06dfb7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:10.857226 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 req-68561f08-56b1-4e80-9b02-9436fe06dfb7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0478301 Dec 14 03:18:10.905903 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 req-a139d7ce-22ea-412e-af24-fc837872aadd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420306 Dec 14 03:18:10.950907 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:18:10.961772 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Sync routers for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:18:10.969014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:10.970787 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:18:10.971444 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:17:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:10.998328 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e75e6421-642c-4d7f-bea4-d3b8ef03628e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5702965 Dec 14 03:18:10.998328 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:10.998760 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:10.998894 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 53158) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.005330 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-309499008', 'description': 'tempest-secgroup-smoke-309499008 description', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.035103 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.049135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2451088-0761-4bba-a99c-a0bbae6b812b x-openstack-request-id: req-c2451088-0761-4bba-a99c-a0bbae6b812b {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:11.049517 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:11.049842 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c2451088-0761-4bba-a99c-a0bbae6b812b {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:11.050361 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:18:11.082269 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:18:11.104599 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.117822 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.173324 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.174638 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1748586 Dec 14 03:18:11.177599 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 53164) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.182073 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.190714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e30f0e7b-834b-4f1b-903d-323a367bb3b0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa44b3d3-acb1-44ee-af7e-bffca3aa686e,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:11.194007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.197577 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-4582d121-66f3-4b65-85ab-2cc4d6772f8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:11.199076 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-4582d121-66f3-4b65-85ab-2cc4d6772f8f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1099 time: 0.0913763 Dec 14 03:18:11.265411 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.334238 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'bd0e6ea6-d92a-472e-bfe1-9a23ceee8930', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'floating_ip_address': '172.27.3.143', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'port_id': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 377, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'mac_address': 'fa:16:3e:fa:b0:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:18:10Z', 'updated_at': '2021-12-14T03:18:10Z', 'revision_number': 0, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:11.342723 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-12a256e2-e7e9-4c76-a907-52063c2634c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:11.344212 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-12a256e2-e7e9-4c76-a907-52063c2634c3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.1336508 Dec 14 03:18:11.364572 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Checking router: 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:18:11.365681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.376102 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:18:11.377024 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:17:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:11.400639 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.446398 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e9fb80d-af79-43d3-9620-0d5cf17b0d18,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:11.455941 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.457118 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-8faa151c-65a7-4e5c-828e-d64da3757200 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2786102 Dec 14 03:18:11.459990 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53166) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.465496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.474652 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-8430dceb-2b3c-4e99-9648-874f15b9a3b2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 1000 time: 0.1210759 Dec 14 03:18:11.487796 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:18:11.498259 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.537425 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-8e021064-6af2-4a0a-bad2-0e5353a7616d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:11.538954 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-8e021064-6af2-4a0a-bad2-0e5353a7616d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0508585 Dec 14 03:18:11.564479 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.568744 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.589034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b1878c6d-0d9a-4517-82e0-facbb3201eaa,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:11.600131 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.601410 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6cc58c6b-e849-4ce1-ae1a-b10a9d81cc73 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1402669 Dec 14 03:18:11.604111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53172) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.611989 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.642644 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.699404 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-fbda893e-e8ce-408d-a30c-fed0fcc16233 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:11.700920 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-fbda893e-e8ce-408d-a30c-fed0fcc16233 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1157377 Dec 14 03:18:11.720802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 req-402faafa-3b6a-458b-8f02-0dd5c3ec66d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:11.722946 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 req-402faafa-3b6a-458b-8f02-0dd5c3ec66d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 945 time: 0.0845580 Dec 14 03:18:11.733403 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.739626 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.760465 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6248e90c-fb26-4904-8fe0-04b406bd0994,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:11.761226 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'bd0e6ea6-d92a-472e-bfe1-9a23ceee8930', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'floating_ip_address': '172.27.3.143', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'port_id': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 377, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'mac_address': 'fa:16:3e:fa:b0:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:18:10Z', 'updated_at': '2021-12-14T03:18:10Z', 'revision_number': 0, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:11.788139 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.789379 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-2a5cbacc-6c4f-457c-9126-a117b9597e02 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1843147 Dec 14 03:18:11.792068 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53176) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.796572 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.800565 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-403718ac-a7d3-4514-b59a-2d4b0772459e None None] The sync data for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi is: [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'bd0e6ea6-d92a-472e-bfe1-9a23ceee8930', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'floating_ip_address': '172.27.3.143', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'port_id': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 377, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'mac_address': 'fa:16:3e:fa:b0:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:18:10Z', 'updated_at': '2021-12-14T03:18:10Z', 'revision_number': 0, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:18:11.830913 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.833880 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 req-fed7ca99-5da4-4fff-a49b-8436e996010d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985339 Dec 14 03:18:11.882817 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-439acc86-fc94-4eee-96e9-9c56753a1fa9 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1584914 Dec 14 03:18:11.907623 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.911511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.930300 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e9c34ab-72b2-4d72-99b4-76ecbc10bef0,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:11.941704 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:11.942941 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-61f0bddd-7490-499c-8439-f91cab20a60d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1498439 Dec 14 03:18:11.945701 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53180) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:11.950323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:11.982530 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.securitygroups_db [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Project bc2e5ee76edf4e358f418773bf824ed7 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:18:11.990195 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.002474 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-43c2d66f-0c73-4c68-a9ee-a8c6bbb1f842 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1105971 Dec 14 03:18:12.050482 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e03c0e18-ca49-45a1-ac09-02f0ab3f54cf None None] New status for floating IP bd0e6ea6-d92a-472e-bfe1-9a23ceee8930: ACTIVE {{(pid=102573) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:18:12.065352 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652f1575-5646-40cd-bf1d-55c8598b9059 req-cc57baed-7b99-4088-8609-533c4b084ea1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:12.066878 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-652f1575-5646-40cd-bf1d-55c8598b9059 req-cc57baed-7b99-4088-8609-533c4b084ea1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0627818 Dec 14 03:18:12.067010 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.071363 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.090952 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61181a5b-24e8-4e53-98d9-0ccb7c6c561d,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:12.099520 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.100789 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-18466474-aa06-4706-9436-c9842a0e8bcf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1539977 Dec 14 03:18:12.103418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53182) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:12.109032 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'security_group_rule': {'security_group_id': 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e', 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:12.125448 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-652f1575-5646-40cd-bf1d-55c8598b9059 req-b64503ee-d705-4404-8da5-2328ef026260 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513513 Dec 14 03:18:12.132364 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.securitygroups_db [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Project bc2e5ee76edf4e358f418773bf824ed7 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:18:12.137648 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.201018 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.204787 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.226015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c7fc454-0a45-42b9-b16a-3f77132f71c7,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:12.240121 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.244114 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-631b8807-e5ef-4447-ac18-7734c66ec478 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1360910 Dec 14 03:18:12.333036 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-52165200-b413-466d-9125-f7b7a8f3bbdf tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-309499008&fields=id&tenant_id=bc2e5ee76edf4e358f418773bf824ed7 HTTP/1.1" status: 200 len: 267 time: 0.0447867 Dec 14 03:18:12.385582 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-424dafe9-6ee6-4faf-99cf-ab250a57ace6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:12.386560 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-424dafe9-6ee6-4faf-99cf-ab250a57ace6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0476379 Dec 14 03:18:12.399517 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'port': {'security_groups': ['c5aea58c-8de2-497c-802a-0d4e5575f808', 'fa44b3d3-acb1-44ee-af7e-bffca3aa686e']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:12.464504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.681833 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:12.711182 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.717621 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.762038 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:12.762712 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:12.764201 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b78de4a-3b9d-445c-8909-7f9b962ba846 req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "PUT /v2.0/ports/bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 982 time: 0.3692372 Dec 14 03:18:12.767121 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:12.769518 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7017c513-52b7-4c0b-bf0a-4bed8dd14860" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:12.778549 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:12.802316 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e83fa8d-afea-4bdb-8fd9-bfb18a29166f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=6']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:12.823956 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 x-openstack-request-id: req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:12.824368 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:12.824628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:12.825026 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:18:12.914388 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69dd2ed4-1d15-436f-b609-57249ec4e96c req-ffa2b5ab-e38b-41bb-9ad7-ab1793fac788 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:12.916174 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69dd2ed4-1d15-436f-b609-57249ec4e96c req-ffa2b5ab-e38b-41bb-9ad7-ab1793fac788 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0816500 Dec 14 03:18:12.974404 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-c72a2260-11b9-412a-8405-6e52571678ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:12.976030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-c72a2260-11b9-412a-8405-6e52571678ac service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1138 time: 0.0814021 Dec 14 03:18:13.026752 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69dd2ed4-1d15-436f-b609-57249ec4e96c req-b16dda5a-aefb-4025-a89f-2fe6f7a93289 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0961587 Dec 14 03:18:13.031823 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:13.100339 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-89ff1cb4-370f-4d03-b8bb-f0a0a7fe8ff2 None None] Provisioning complete for port bb3c28d2-c03d-4924-8dd8-da975e5427e4 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:18:13.100700 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-89ff1cb4-370f-4d03-b8bb-f0a0a7fe8ff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:13.136595 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d777ccee-e184-43f6-8ede-e9eb9407513e req-6e1649ae-b027-4895-a1a1-7378304aa4b9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:13.138072 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d777ccee-e184-43f6-8ede-e9eb9407513e req-6e1649ae-b027-4895-a1a1-7378304aa4b9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 945 time: 0.0774903 Dec 14 03:18:13.141910 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-d9e3bd8f-d5e0-4226-a542-958f511df6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:13.143264 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-d9e3bd8f-d5e0-4226-a542-958f511df6ab service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.1482692 Dec 14 03:18:13.144831 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:18:13.274864 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d777ccee-e184-43f6-8ede-e9eb9407513e req-1bf098bc-ac22-457f-bfcb-31b47d8a7dad tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1296384 Dec 14 03:18:13.286128 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-019161ba-8c69-46e9-8e06-d012c68dc229 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 1002 time: 0.1289058 Dec 14 03:18:13.310631 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b req-7e7622b5-ab93-4f22-85f5-8df78acd8594 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:13.316023 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b req-7e7622b5-ab93-4f22-85f5-8df78acd8594 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1036904 Dec 14 03:18:13.375237 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-3bd3a8b3-78af-4339-8748-df098cf717b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:13.377263 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-3bd3a8b3-78af-4339-8748-df098cf717b5 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0821769 Dec 14 03:18:13.426406 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b req-8c08fc53-43b8-4e6d-bdda-8fd9021db52b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925245 Dec 14 03:18:13.443319 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-809a53a1-e8d2-4515-97a6-5aca9f0ce095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:13.444975 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-809a53a1-e8d2-4515-97a6-5aca9f0ce095 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0544314 Dec 14 03:18:13.465667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:18:13.483118 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:18:13.483481 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:13.679775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:13.722594 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:13.725582 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6425f0c1-45b4-45e6-a220-31e5eea86f76" -d '{"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-plugged", "status": "completed", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:13.743221 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:13.753684 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:13.781189 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-a81ea9dc-f291-468b-a0d2-0198059d3255 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3014193 Dec 14 03:18:13.792702 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 x-openstack-request-id: req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:13.793170 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-plugged", "status": "completed", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:13.793287 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:13.793584 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', 'code': 200} Dec 14 03:18:13.833036 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:13.936975 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-6fc0e824-ccc8-4a30-a34b-ecad8c1d5e57 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940192 Dec 14 03:18:14.055167 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b9232f-9467-41da-bc8a-636bdc264fd3 req-ca8a2ebf-d9cf-4c99-9dd5-4a7198465e34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:14.056590 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58b9232f-9467-41da-bc8a-636bdc264fd3 req-ca8a2ebf-d9cf-4c99-9dd5-4a7198465e34 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 1099 time: 0.0405891 Dec 14 03:18:14.109551 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58b9232f-9467-41da-bc8a-636bdc264fd3 req-aa15036d-cfb9-4cd5-97c0-e7602d33db43 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386648 Dec 14 03:18:14.394434 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3577dd5-a116-4574-a97e-aae4b76dee1f req-e623b7f2-fae7-4652-9114-cdafa67d46a9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:14.396668 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3577dd5-a116-4574-a97e-aae4b76dee1f req-e623b7f2-fae7-4652-9114-cdafa67d46a9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0502822 Dec 14 03:18:14.444217 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3577dd5-a116-4574-a97e-aae4b76dee1f req-81e799d6-27fe-488c-94e3-ec18a14d72df tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417261 Dec 14 03:18:14.552695 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 req-c812f9d3-b863-4326-b505-7d2e23e1aa83 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:14.554160 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 req-c812f9d3-b863-4326-b505-7d2e23e1aa83 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0520301 Dec 14 03:18:14.602092 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 req-7c887995-1044-4876-acd6-3dc60864f5ae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418222 Dec 14 03:18:15.562319 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 req-1638c2c6-f40c-44fe-b15a-60907f40053f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:15.563799 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 req-1638c2c6-f40c-44fe-b15a-60907f40053f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0475900 Dec 14 03:18:15.610725 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 req-ecd781e7-bf7a-431f-bc56-606b18e6b7c6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410850 Dec 14 03:18:15.721661 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a req-c87521c4-b7b3-4506-b042-2c586e3b476b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:15.723155 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a req-c87521c4-b7b3-4506-b042-2c586e3b476b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0512388 Dec 14 03:18:15.774764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a req-31488f86-e65e-4168-ac07-561ec3f7db77 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456045 Dec 14 03:18:16.736026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8070ab6-75eb-4115-a3c0-710510faf9f9 req-90e4a340-acdf-48df-8019-871ca913a551 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:16.737783 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a8070ab6-75eb-4115-a3c0-710510faf9f9 req-90e4a340-acdf-48df-8019-871ca913a551 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0489283 Dec 14 03:18:16.785175 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a8070ab6-75eb-4115-a3c0-710510faf9f9 req-1a240fe3-2c98-410d-b488-4f532b4ac1db tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406535 Dec 14 03:18:16.896321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d req-28f5db39-150b-4661-b6ea-72312dced1a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:16.897721 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d req-28f5db39-150b-4661-b6ea-72312dced1a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0519295 Dec 14 03:18:16.953690 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d req-ebf90c9a-d25e-48ba-b383-4cc676a7f032 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498593 Dec 14 03:18:18.073498 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f799dd5-9347-4746-b5e2-7e3daa23b669 req-78168a05-8846-4807-b4f6-04088ea48f8e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:18.074973 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3f799dd5-9347-4746-b5e2-7e3daa23b669 req-78168a05-8846-4807-b4f6-04088ea48f8e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0474024 Dec 14 03:18:18.122877 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3f799dd5-9347-4746-b5e2-7e3daa23b669 req-82ef1560-b490-4a9c-99ea-0c610e7301f0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415442 Dec 14 03:18:19.269922 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6fcb787-d69e-4876-99e5-d10859c11d67 req-007957f5-6de2-44d2-8b5f-175846a294e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:19.271358 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6fcb787-d69e-4876-99e5-d10859c11d67 req-007957f5-6de2-44d2-8b5f-175846a294e4 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0717282 Dec 14 03:18:19.278745 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 req-b7b49dbe-7639-4d25-9a8f-967092d38dc2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:19.280105 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 req-b7b49dbe-7639-4d25-9a8f-967092d38dc2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0824423 Dec 14 03:18:19.342043 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6fcb787-d69e-4876-99e5-d10859c11d67 req-f145ff3a-ee0e-4a18-994f-8371d4771c31 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610170 Dec 14 03:18:19.353693 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 req-fdddda6a-abec-4546-ab82-618cb00a6b78 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671122 Dec 14 03:18:19.659161 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-371f566b-26db-4971-aab7-b956da8d46ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:20.473383 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915acfb0-6e6d-4a48-b013-70bbd08a5322 req-f4605d17-f3a1-4293-96e2-fe5625859109 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:20.474794 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-915acfb0-6e6d-4a48-b013-70bbd08a5322 req-f4605d17-f3a1-4293-96e2-fe5625859109 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0489781 Dec 14 03:18:20.521245 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-915acfb0-6e6d-4a48-b013-70bbd08a5322 req-ecb9fdbc-2f7a-41d9-8fb5-d3dc0ac0f2ae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404251 Dec 14 03:18:21.641907 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ca4f46-0940-406e-995b-ca779e82b4b1 req-e88cbc3a-9555-4302-a916-28fb6dbe216f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:21.643396 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8ca4f46-0940-406e-995b-ca779e82b4b1 req-e88cbc3a-9555-4302-a916-28fb6dbe216f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0495496 Dec 14 03:18:21.693679 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8ca4f46-0940-406e-995b-ca779e82b4b1 req-a53f45d7-2d00-484f-a604-13daedf1923e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444930 Dec 14 03:18:21.859705 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a682aa5e-faa4-4617-b914-ea1649771608 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:22.049551 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccb12de-200c-4529-9116-7c9fd942491f req-884740a0-f359-4cdb-88dd-39995d8421da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:22.051030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ccb12de-200c-4529-9116-7c9fd942491f req-884740a0-f359-4cdb-88dd-39995d8421da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0696242 Dec 14 03:18:22.074007 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-c3336f0a-f0b0-4916-86f1-bafd623357f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:22.075434 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-c3336f0a-f0b0-4916-86f1-bafd623357f2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bb4be946dd9b4b2080fb3b398521624e&device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 1098 time: 0.0628238 Dec 14 03:18:22.121383 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ccb12de-200c-4529-9116-7c9fd942491f req-dcfc8b06-0df8-408f-962f-a85f018f7457 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637534 Dec 14 03:18:22.188452 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-162c3614-6420-436d-9009-0de8f6c964e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:22.189906 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-162c3614-6420-436d-9009-0de8f6c964e3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 200 len: 919 time: 0.1000593 Dec 14 03:18:22.240390 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-34c6bccc-1132-4aba-99d6-84a41719a70e service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 200 len: 217 time: 0.0341315 Dec 14 03:18:22.311344 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-a0b311a6-7e98-48d7-a18b-1fe85a065749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:22.312746 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-a0b311a6-7e98-48d7-a18b-1fe85a065749 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 200 len: 858 time: 0.0419736 Dec 14 03:18:22.357723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-7a365bef-b319-4962-a795-e9d4709bb8ef service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=b4af40aa-6be1-48c2-866d-05aa1bdec9d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263965 Dec 14 03:18:22.447190 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-2cf88c16-eac4-4242-9a57-af7b4cc83418 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787385 Dec 14 03:18:22.544191 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b47bedd9-327a-4368-8aab-4282e04c9cf4 req-7d4df62c-02b8-46ea-8a76-6f70d9212737 service neutron] 10.222.0.20 "GET /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815730 Dec 14 03:18:23.245565 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 req-46c8d4be-169a-472f-b0f1-258b55355a60 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:23.247033 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 req-46c8d4be-169a-472f-b0f1-258b55355a60 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0491803 Dec 14 03:18:23.294992 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 req-54949592-5b69-4c15-835c-641db13f3491 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421295 Dec 14 03:18:23.574978 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:24.411946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e13556-e6b5-4e61-b3c9-66918269c567 req-d04e17f0-059c-4142-9610-bc7a41d81aa9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:24.413396 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27e13556-e6b5-4e61-b3c9-66918269c567 req-d04e17f0-059c-4142-9610-bc7a41d81aa9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0481281 Dec 14 03:18:24.458239 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27e13556-e6b5-4e61-b3c9-66918269c567 req-30f3b2bf-eaad-4fd2-9480-27c2b13255c1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391259 Dec 14 03:18:24.558346 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:25.576933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11175509-4bd8-454b-ada0-d052bb7a62d4 req-cce341fc-edcc-484b-ad5e-0435c5d71b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:25.578408 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-11175509-4bd8-454b-ada0-d052bb7a62d4 req-cce341fc-edcc-484b-ad5e-0435c5d71b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0498981 Dec 14 03:18:25.623688 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-11175509-4bd8-454b-ada0-d052bb7a62d4 req-69502927-7048-4d30-8b1a-a5f360f2ebb3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389421 Dec 14 03:18:25.788322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:26.740377 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 req-f1b1c30f-fcec-4850-8d75-bfc552168119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:26.741737 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 req-f1b1c30f-fcec-4850-8d75-bfc552168119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0473027 Dec 14 03:18:26.788723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 req-e6d8a2e9-e89b-4790-b51f-e1055954097a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413008 Dec 14 03:18:27.911078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a692324a-16a2-4f8b-8236-908be547baf3 req-4d77a0c3-7f40-4837-a8d6-551105d01efc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:27.912443 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a692324a-16a2-4f8b-8236-908be547baf3 req-4d77a0c3-7f40-4837-a8d6-551105d01efc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0509088 Dec 14 03:18:27.963562 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a692324a-16a2-4f8b-8236-908be547baf3 req-2495a53f-9ad4-4bb8-b1c0-c3be7d3e115f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453787 Dec 14 03:18:32.361308 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-81396d18-3302-4a3e-a3b1-103e7c30d0f3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:32.362813 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-81396d18-3302-4a3e-a3b1-103e7c30d0f3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1028154 Dec 14 03:18:32.378708 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-de3e0174-ded4-4cb6-9f7d-c76dcaec47a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/quotas/7ecea5c13a624ab8a3a445d3ede5fd77 HTTP/1.1" status: 200 len: 375 time: 0.0093682 Dec 14 03:18:32.436334 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-56e861d1-2256-421c-a0de-62a6d356756b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0521135 Dec 14 03:18:32.527329 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-a2f3c5e9-65ea-46c2-b865-39368c179654 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837696 Dec 14 03:18:32.625672 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-cc707698-b900-474c-8a7c-2b5db571c740 service neutron] 10.222.0.43 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921018 Dec 14 03:18:32.796838 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ac05b59a-fe8c-4990-9068-371fa48455d8 req-81efb823-8d57-47c4-aa2f-4f32c5a9ea8d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 210 time: 0.0266273 Dec 14 03:18:33.742490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-603a1203-4e0b-4875-85e5-dbfb8243856e req-5e3116e3-5b15-4a0a-8dbc-8bcb44d51bec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:33.744324 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-603a1203-4e0b-4875-85e5-dbfb8243856e req-5e3116e3-5b15-4a0a-8dbc-8bcb44d51bec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0530508 Dec 14 03:18:33.805176 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-603a1203-4e0b-4875-85e5-dbfb8243856e req-674b64da-7e64-4c01-98df-deb0278d89b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543342 Dec 14 03:18:33.894124 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58e90c45-85be-41c9-8f04-6301b74a0178 req-fac7f589-12ec-4889-8592-58b053d8f54f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 210 time: 0.0254695 Dec 14 03:18:34.229960 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-870cbb3f-3a4d-4ff9-b5e1-6f40629ea275 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:34.231439 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-870cbb3f-3a4d-4ff9-b5e1-6f40629ea275 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 815 time: 0.1064069 Dec 14 03:18:34.277883 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Request body: {'port': {'device_id': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'admin_state_up': True, 'tenant_id': '7ecea5c13a624ab8a3a445d3ede5fd77'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:34.386764 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Made reservation on behalf of 7ecea5c13a624ab8a3a445d3ede5fd77 for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:18:34.390217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:34.514944 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Allocated IP 172.20.0.13 (69a3889e-636a-4983-9398-edafd7db5301/5cfcc7bf-6dc9-4045-a09c-867974704f94/2ee7b357-17c9-4ac1-be00-9130e426631c) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:18:34.655892 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:34.689568 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:34.732183 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Network 69a3889e-636a-4983-9398-edafd7db5301 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:18:34.735236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:18:34.737444 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', '9ffbafb8-f71a-4067-8988-a284fbb41603', 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:34.739574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:18:34.745228 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:34.745845 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:34.752042 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event updated for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:34.767613 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-05675b52-42a8-4f50-a93f-e104f5a19980 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.4942679 Dec 14 03:18:34.796248 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Request body: {'port': {'device_id': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:18:34.853738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.102241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677c6209-fb0f-48b3-915f-95e79dc2eabb req-eb2b8832-8c8d-4dbd-86a3-66f4b6543393 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.103720 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-677c6209-fb0f-48b3-915f-95e79dc2eabb req-eb2b8832-8c8d-4dbd-86a3-66f4b6543393 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.1312416 Dec 14 03:18:35.159367 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758d9ec8-a7ae-40f9-b536-45bbab61199b req-ed6ad9d0-817c-4792-9512-07484445aed7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.161329 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-758d9ec8-a7ae-40f9-b536-45bbab61199b req-ed6ad9d0-817c-4792-9512-07484445aed7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 932 time: 0.1360984 Dec 14 03:18:35.221375 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-677c6209-fb0f-48b3-915f-95e79dc2eabb req-458b0cdb-cff8-43be-981b-5ede11dc7ce8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1091290 Dec 14 03:18:35.276391 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-758d9ec8-a7ae-40f9-b536-45bbab61199b req-d010cd41-9436-4505-9ad1-793107b52042 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067386 Dec 14 03:18:35.284827 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ee7b357-17c9-4ac1-be00-9130e426631c {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:18:35.292975 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.328420 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Transition to ACTIVE for port object 2ee7b357-17c9-4ac1-be00-9130e426631c will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:18:35.332479 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.387349 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 req-23edac6b-b58d-4a0f-a0e3-d0e8abee9ed6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.388812 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 req-23edac6b-b58d-4a0f-a0e3-d0e8abee9ed6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0933995 Dec 14 03:18:35.402350 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Pushing event updated for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:35.461302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Attempting to bind port 2ee7b357-17c9-4ac1-be00-9130e426631c on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:18:35.461631 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Attempting to bind port 2ee7b357-17c9-4ac1-be00-9130e426631c by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:18:35.461952 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Attempting to bind port 2ee7b357-17c9-4ac1-be00-9130e426631c on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:18:35.474345 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 req-dbc9d7ba-42de-4d7e-92e3-20fc1c0c9024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746844 Dec 14 03:18:35.474501 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Port 2ee7b357-17c9-4ac1-be00-9130e426631c on network 69a3889e-636a-4983-9398-edafd7db5301 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:18:35.474725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Attempting to bind port 2ee7b357-17c9-4ac1-be00-9130e426631c on network 69a3889e-636a-4983-9398-edafd7db5301 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:18:35.479624 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 18, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:18:35.479949 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Checking segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:18:35.480316 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Bound using segment: {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:18:35.480737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Bound port: 2ee7b357-17c9-4ac1-be00-9130e426631c, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36876166-6080-44fb-9026-20129e125f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '69a3889e-636a-4983-9398-edafd7db5301'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:18:35.481083 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.541142 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:18:35.544435 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=2ee7b357-17c9-4ac1-be00-9130e426631c,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:18:35.548374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.584801 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.585421 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:35.586776 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] 10.222.0.20 "PUT /v2.0/ports/2ee7b357-17c9-4ac1-be00-9130e426631c HTTP/1.1" status: 200 len: 1094 time: 0.7948141 Dec 14 03:18:35.587244 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:35.589444 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-711aa1b3-e22a-497e-8393-619e5dc30944" -d '{"events": [{"name": "network-changed", "server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:35.612648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a6ac3c-fd0a-420e-9524-af710c342d2d service neutron] Pushing event updated for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:35.626971 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a x-openstack-request-id: req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:35.627289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:35.627545 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:35.627938 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c', 'status': 'completed', 'code': 200} Dec 14 03:18:35.718252 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-0eefa731-502c-4baa-914f-51f01bf5b487 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.719735 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-0eefa731-502c-4baa-914f-51f01bf5b487 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 1097 time: 0.0392399 Dec 14 03:18:35.774099 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-84a4f997-e672-4b5a-baa9-e1d55e3aef74 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2ee7b357-17c9-4ac1-be00-9130e426631c HTTP/1.1" status: 200 len: 217 time: 0.0332079 Dec 14 03:18:35.825393 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd579fa-bfde-437d-8767-017652a43d87 req-bf1342b7-8a75-4c5a-9021-84568e286ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:35.826842 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-bf1342b7-8a75-4c5a-9021-84568e286ab2 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0447481 Dec 14 03:18:35.864483 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-c664ff34-eccd-42f0-a51e-db9718135a30 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273919 Dec 14 03:18:35.962348 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-599aec0f-6198-426d-ad4f-0ab219f2ecde service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822220 Dec 14 03:18:36.057883 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5fd579fa-bfde-437d-8767-017652a43d87 req-2f065792-5e80-431d-90ee-59ef46c50a84 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859966 Dec 14 03:18:36.264056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-3edda4aa-b2e4-4f46-a2da-3a85e57718f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.265577 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-3edda4aa-b2e4-4f46-a2da-3a85e57718f6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 1097 time: 0.0412099 Dec 14 03:18:36.640501 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a217f345-7a11-403a-866a-ecbd17ed91d5 req-a6a9b0a8-acba-4329-8ca8-ef5610b98fa6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.641929 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a217f345-7a11-403a-866a-ecbd17ed91d5 req-a6a9b0a8-acba-4329-8ca8-ef5610b98fa6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.3366861 Dec 14 03:18:36.661660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-5455353d-24fa-40da-badd-d63d39715520 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.663155 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-5455353d-24fa-40da-badd-d63d39715520 service neutron] 10.222.0.20 "GET /v2.0/networks?id=69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 200 len: 916 time: 0.3756166 Dec 14 03:18:36.676660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402ebc0a-2043-4344-af51-01d18ddeae57 req-f2c4e107-51ce-4c9f-9605-8fbc67633082 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.678042 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-402ebc0a-2043-4344-af51-01d18ddeae57 req-f2c4e107-51ce-4c9f-9605-8fbc67633082 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 944 time: 0.1113911 Dec 14 03:18:36.728995 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-0c8d4f53-9f00-4194-919a-4db1fbcc3a40 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2ee7b357-17c9-4ac1-be00-9130e426631c HTTP/1.1" status: 200 len: 217 time: 0.0485384 Dec 14 03:18:36.789603 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a217f345-7a11-403a-866a-ecbd17ed91d5 req-a073353b-d002-46dd-9f40-abec08f8953d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1413000 Dec 14 03:18:36.809811 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-402ebc0a-2043-4344-af51-01d18ddeae57 req-ac7a6644-c1d7-4a55-b739-2724268a201c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1219084 Dec 14 03:18:36.813141 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-921f0d68-e99b-4bc5-81d1-5d42d51ac5c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.814582 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-921f0d68-e99b-4bc5-81d1-5d42d51ac5c5 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 200 len: 855 time: 0.0730314 Dec 14 03:18:36.849181 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-9861d0e5-317c-454a-8dea-ae7a425c4337 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=69a3889e-636a-4983-9398-edafd7db5301&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252934 Dec 14 03:18:36.953607 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef req-b2f93ae7-e077-444f-9f64-561edc5138c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:36.955541 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef req-b2f93ae7-e077-444f-9f64-561edc5138c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.1052768 Dec 14 03:18:36.984852 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-07a5681b-a185-49f0-8411-5b3797878bd7 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258776 Dec 14 03:18:37.062920 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef req-a254c53c-9b4c-49a5-9592-a897545f75d1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992656 Dec 14 03:18:37.104973 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-34690d06-b141-4579-920b-bd9edd08c673 service neutron] 10.222.0.20 "GET /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1073232 Dec 14 03:18:37.841569 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53598) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:37.944822 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9882342c-5b01-4973-8f73-2b0f0b60c40f req-a588f102-58d7-4eb3-afc4-72daea475555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:37.946277 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9882342c-5b01-4973-8f73-2b0f0b60c40f req-a588f102-58d7-4eb3-afc4-72daea475555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0764978 Dec 14 03:18:37.947216 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8ca40156-5413-411e-96e9-d5fb4a27e7f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:37.953601 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 req-7d6939c8-1eb7-4a33-9bed-44431db7edc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:37.955138 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 req-7d6939c8-1eb7-4a33-9bed-44431db7edc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 944 time: 0.0744982 Dec 14 03:18:38.033092 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9882342c-5b01-4973-8f73-2b0f0b60c40f req-fc021f1c-4b5b-4daf-8981-406d7ff711f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0770078 Dec 14 03:18:38.033340 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8ca40156-5413-411e-96e9-d5fb4a27e7f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.038484 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8ca40156-5413-411e-96e9-d5fb4a27e7f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.038979 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 req-6f59b591-6c3f-4bb0-86b2-39fdeead5f88 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759382 Dec 14 03:18:38.084319 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ca40156-5413-411e-96e9-d5fb4a27e7f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7207c5e-9346-4e87-9c49-bf2ddf734715,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:38.095147 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8ca40156-5413-411e-96e9-d5fb4a27e7f0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=011632315e3446548bfe43987fb7de9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2524030 Dec 14 03:18:38.096176 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 53606) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:38.172286 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.199014 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dc362a-17c9-435f-a26e-efca37c2ab95 req-5684ccaa-a75e-41da-b28f-980ed1855c65 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:38.200481 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a0dc362a-17c9-435f-a26e-efca37c2ab95 req-5684ccaa-a75e-41da-b28f-980ed1855c65 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0700483 Dec 14 03:18:38.204787 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.272009 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a0dc362a-17c9-435f-a26e-efca37c2ab95 req-11004d5e-6c64-4615-82cc-671ce41c9c66 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653462 Dec 14 03:18:38.284559 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.287287 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:38.288354 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b7207c5e-9346-4e87-9c49-bf2ddf734715 HTTP/1.1" status: 204 len: 168 time: 0.1912572 Dec 14 03:18:38.296009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09ae2111-29fd-4742-8ea4-27a7b4b3636e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7207c5e-9346-4e87-9c49-bf2ddf734715,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:39.182785 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35cc3105-b658-4ba1-afa0-5cd809c822cc req-85d33d2e-927c-471e-9746-9525944b90d2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:39.184265 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-35cc3105-b658-4ba1-afa0-5cd809c822cc req-85d33d2e-927c-471e-9746-9525944b90d2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 944 time: 0.0781517 Dec 14 03:18:39.191405 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9808fc38-840c-46b0-a81f-64997ebc2b1d req-aab05547-0937-4149-bf62-10a9c52ec814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:39.192721 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9808fc38-840c-46b0-a81f-64997ebc2b1d req-aab05547-0937-4149-bf62-10a9c52ec814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0773208 Dec 14 03:18:39.284656 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-35cc3105-b658-4ba1-afa0-5cd809c822cc req-ab6ed148-5048-450c-94c2-71db15578161 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909944 Dec 14 03:18:39.290495 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9808fc38-840c-46b0-a81f-64997ebc2b1d req-85cab7ce-28cf-417e-9388-41fc1f11a76f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0912726 Dec 14 03:18:39.323255 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-28df9902-1f91-4b5e-9e12-f9ea9270d7da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:39.324634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-28df9902-1f91-4b5e-9e12-f9ea9270d7da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0744209 Dec 14 03:18:39.440555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab req-4fc21d3c-38c9-4ded-9f7b-490dd4d00c0f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:39.442646 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab req-4fc21d3c-38c9-4ded-9f7b-490dd4d00c0f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 946 time: 0.0984707 Dec 14 03:18:39.473513 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Deleting port 4b8834a4-3f18-49ea-b3a2-4053d903f624 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:18:39.473842 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:39.542180 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab req-d5f6a7ed-0d0e-4f0e-a0a1-adc6b6e74ccf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922632 Dec 14 03:18:39.578903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] For port 4b8834a4-3f18-49ea-b3a2-4053d903f624, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4b8834a4-3f18-49ea-b3a2-4053d903f624,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:39.579405 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:39.592737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling delete_port for 4b8834a4-3f18-49ea-b3a2-4053d903f624 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:18:39.745398 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:39.772698 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Pushing event deleted for resources: {'Port': ['ID=4b8834a4-3f18-49ea-b3a2-4053d903f624,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:39.794982 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['4b8834a4-3f18-49ea-b3a2-4053d903f624', '9d0f1802-5b85-4dd7-847f-3cdd0b182adf'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:39.817561 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.817902 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.818239 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.818572 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.818906 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.819261 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.819870 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.820194 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.820521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.820836 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.821154 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.821470 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.821785 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:39.842921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] No DVR routers for this DVR port 4b8834a4-3f18-49ea-b3a2-4053d903f624 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:18:39.846311 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:39.850328 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ecd7344c-b29b-47fd-a4c9-1060fb1587da req-727172e2-d77c-43ee-8b1b-6281c90c2c7e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "DELETE /v2.0/ports/4b8834a4-3f18-49ea-b3a2-4053d903f624 HTTP/1.1" status: 204 len: 173 time: 0.5132313 Dec 14 03:18:39.850772 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'name': 'network-vif-deleted', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:39.853021 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54e8a079-d3e2-48d3-9ef3-cd8624560245" -d '{"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-deleted", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:39.893140 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec4047e1-0948-4145-8a83-be44e13707db x-openstack-request-id: req-ec4047e1-0948-4145-8a83-be44e13707db {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:39.893504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-deleted", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:39.893935 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ec4047e1-0948-4145-8a83-be44e13707db {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:39.894397 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6283570-4ee2-47bc-b58a-fbfe57acbcde', 'name': 'network-vif-deleted', 'tag': '4b8834a4-3f18-49ea-b3a2-4053d903f624', 'status': 'completed', 'code': 200} Dec 14 03:18:40.437609 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 req-2b0ec41e-389a-46f9-bf18-dd54242d7fbf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:40.439097 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 req-2b0ec41e-389a-46f9-bf18-dd54242d7fbf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0746636 Dec 14 03:18:40.447438 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5dfaf0-0b22-443d-b856-d640a833b68e req-2e002fdc-7219-4caa-9bbb-4e60d459d033 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:40.448788 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a5dfaf0-0b22-443d-b856-d640a833b68e req-2e002fdc-7219-4caa-9bbb-4e60d459d033 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 944 time: 0.0757837 Dec 14 03:18:40.521454 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 req-08932fca-46fe-451c-80e5-65763ac60508 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717320 Dec 14 03:18:40.525697 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1a5dfaf0-0b22-443d-b856-d640a833b68e req-6065f56c-e1c9-468e-94d0-884486a2e805 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704246 Dec 14 03:18:40.649547 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f046e0af-57fd-4f30-b529-153558a1c5cd req-9b9eece0-b2f1-4ca5-9cac-2229fcddaa19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=c6283570-4ee2-47bc-b58a-fbfe57acbcde HTTP/1.1" status: 200 len: 210 time: 0.0280325 Dec 14 03:18:41.192293 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:41.307511 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 2ee7b357-17c9-4ac1-be00-9130e426631c details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:18:41.401249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=2ee7b357-17c9-4ac1-be00-9130e426631c,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:41.412734 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '2ee7b357-17c9-4ac1-be00-9130e426631c', 'network_id': '69a3889e-636a-4983-9398-edafd7db5301', 'port_id': '2ee7b357-17c9-4ac1-be00-9130e426631c', 'mac_address': 'fa:16:3e:07:bf:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 282, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cfcc7bf-6dc9-4045-a09c-867974704f94', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:18:41.447688 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:41.460262 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ee7b357-17c9-4ac1-be00-9130e426631c {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:18:41.479536 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=2ee7b357-17c9-4ac1-be00-9130e426631c,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:41.483406 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:41.527138 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:41.533905 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.534281 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.534654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.535055 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.535911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.536247 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.536588 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.536916 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.537245 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.537590 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.537920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.538245 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.538566 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:18:41.670075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-662d97f2-8c1f-4e84-89d0-c6a72891c332 req-df6e512e-0b8c-49a1-973c-8fe49e62a342 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:41.671633 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-662d97f2-8c1f-4e84-89d0-c6a72891c332 req-df6e512e-0b8c-49a1-973c-8fe49e62a342 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 945 time: 0.0758584 Dec 14 03:18:41.679854 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9d33a09-bbef-4c5c-af88-0129fc905596 req-8235ef0e-e1b5-4e5d-87cf-543863e412fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:41.681291 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a9d33a09-bbef-4c5c-af88-0129fc905596 req-8235ef0e-e1b5-4e5d-87cf-543863e412fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0843441 Dec 14 03:18:41.756801 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-662d97f2-8c1f-4e84-89d0-c6a72891c332 req-59f89998-9828-4fc9-bbc9-08a4f3067d76 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744233 Dec 14 03:18:41.761011 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a9d33a09-bbef-4c5c-af88-0129fc905596 req-76e92c11-5937-42f9-8ae7-a96a71b12c42 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730917 Dec 14 03:18:42.002331 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:18:42.018659 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 req-81ecdd4d-390c-4562-b908-710ad6fb6263 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:42.020072 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 req-81ecdd4d-390c-4562-b908-710ad6fb6263 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0487065 Dec 14 03:18:42.066154 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 req-775ba1e5-b18c-41f4-92ac-b2072105faf8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401864 Dec 14 03:18:42.182825 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['2ee7b357-17c9-4ac1-be00-9130e426631c'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:42.556809 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293ac7ba-be85-4e75-b253-29e68a539cf4 req-f980d811-f440-414e-b6d0-5e1df18ab5f9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:42.558180 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-293ac7ba-be85-4e75-b253-29e68a539cf4 req-f980d811-f440-414e-b6d0-5e1df18ab5f9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0470583 Dec 14 03:18:42.603829 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-293ac7ba-be85-4e75-b253-29e68a539cf4 req-55085e9b-5539-4d06-b8ab-2082ba3d37cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399017 Dec 14 03:18:42.902449 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2617c9a5-e4ae-44bf-b242-94a51c6db003 req-4519f956-92cf-408f-a98b-662993fc7633 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:42.903853 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2617c9a5-e4ae-44bf-b242-94a51c6db003 req-4519f956-92cf-408f-a98b-662993fc7633 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 945 time: 0.0767455 Dec 14 03:18:42.914953 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad req-1131daef-7b18-4856-ab67-370d068d9f63 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:42.916413 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad req-1131daef-7b18-4856-ab67-370d068d9f63 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0806441 Dec 14 03:18:42.982052 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2617c9a5-e4ae-44bf-b242-94a51c6db003 req-e8000ca2-4c35-4225-bfe5-cf68fc38ea09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647075 Dec 14 03:18:42.989211 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad req-b1bf6c58-9e35-4ce6-8d4a-5c48a656dad0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663731 Dec 14 03:18:43.176441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-930d4082-9d94-49d4-bdc4-343fff605b10 req-5861d1fd-388a-4d80-baaa-13469503efeb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.177787 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-930d4082-9d94-49d4-bdc4-343fff605b10 req-5861d1fd-388a-4d80-baaa-13469503efeb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0470650 Dec 14 03:18:43.225695 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-930d4082-9d94-49d4-bdc4-343fff605b10 req-20b322a0-6b40-4ed1-8309-5653a61b8590 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421801 Dec 14 03:18:43.325054 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4b8834a4-3f18-49ea-b3a2-4053d903f624 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:18:43.345545 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 4b8834a4-3f18-49ea-b3a2-4053d903f624 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:18:43.345894 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4b8834a4-3f18-49ea-b3a2-4053d903f624 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:18:43.545420 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-326b36ff-3fda-4b21-8e86-4c4ee5243b04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.546753 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-326b36ff-3fda-4b21-8e86-4c4ee5243b04 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1098 time: 0.0383384 Dec 14 03:18:43.659102 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-8bcdfc1f-acc1-4912-b738-46ffd82d2542 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.661156 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-8bcdfc1f-acc1-4912-b738-46ffd82d2542 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0818927 Dec 14 03:18:43.755317 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-c404ac49-7fe1-42bd-98de-0c731f3f373d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 1000 time: 0.0839930 Dec 14 03:18:43.766694 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c10c504-2d13-4a48-982a-69f94b111c71 req-b8b34609-f83e-4a25-bb48-9a9a06cff441 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.768089 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c10c504-2d13-4a48-982a-69f94b111c71 req-b8b34609-f83e-4a25-bb48-9a9a06cff441 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0907011 Dec 14 03:18:43.838586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-37d8e3d3-bb52-4daf-bf57-08d2b7ee26be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.840013 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-37d8e3d3-bb52-4daf-bf57-08d2b7ee26be service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0711098 Dec 14 03:18:43.846901 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6c10c504-2d13-4a48-982a-69f94b111c71 req-f0e28332-17fc-4471-b4d4-d040c6ffc3b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711815 Dec 14 03:18:43.897490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-94fe30e1-2313-4cf9-b3b9-4e8a18cf1ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:43.898925 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-94fe30e1-2313-4cf9-b3b9-4e8a18cf1ca4 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399034 Dec 14 03:18:43.992479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-9c4ae3c9-eeac-4433-ba5b-8d22f725e122 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794210 Dec 14 03:18:44.160625 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1686df0c-2d24-47d0-b029-788483a97bef req-854939d9-7894-48ba-96a1-9ca3d7f618c5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:44.161980 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1686df0c-2d24-47d0-b029-788483a97bef req-854939d9-7894-48ba-96a1-9ca3d7f618c5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 945 time: 0.1084781 Dec 14 03:18:44.164524 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3fbf8a1-b5f5-4c75-935b-b31c74ec10b1 req-8d1e0540-d350-404e-8030-f6368accb8fc service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1588361 Dec 14 03:18:44.181291 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c20faf3-797d-47d2-889f-97953ab5b866 req-d6972a11-11b1-4d9b-9285-58d024724ca2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:44.182685 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7c20faf3-797d-47d2-889f-97953ab5b866 req-d6972a11-11b1-4d9b-9285-58d024724ca2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0985096 Dec 14 03:18:44.239675 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1686df0c-2d24-47d0-b029-788483a97bef req-921bc969-b99a-4e85-bc15-5331d96e3193 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717268 Dec 14 03:18:44.253821 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7c20faf3-797d-47d2-889f-97953ab5b866 req-29d7d311-9b2e-4918-b643-47c961645834 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638521 Dec 14 03:18:44.340682 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992edb7e-7f13-46c1-be03-e1edc3f18a6b req-11920a34-3c16-41cb-a61e-cf1b1131e7fa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:44.342126 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-992edb7e-7f13-46c1-be03-e1edc3f18a6b req-11920a34-3c16-41cb-a61e-cf1b1131e7fa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0473762 Dec 14 03:18:44.389266 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-992edb7e-7f13-46c1-be03-e1edc3f18a6b req-688969a5-ce24-4868-86ed-b8cebb60cd2e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406730 Dec 14 03:18:44.959396 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139c55cd-266d-4c33-a48a-c8c485687ac9 req-bf795b28-3df2-47e1-9767-c12b78f03492 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:44.960764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-139c55cd-266d-4c33-a48a-c8c485687ac9 req-bf795b28-3df2-47e1-9767-c12b78f03492 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0471439 Dec 14 03:18:45.009536 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-139c55cd-266d-4c33-a48a-c8c485687ac9 req-74f834ab-f2fe-495d-946e-dd381d7da925 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430534 Dec 14 03:18:45.348469 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 2ee7b357-17c9-4ac1-be00-9130e426631c up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:18:45.377548 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c req-0a64ee2d-56f6-4d38-8bae-77ff135c12ed tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:45.379660 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c req-0a64ee2d-56f6-4d38-8bae-77ff135c12ed tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 945 time: 0.0722346 Dec 14 03:18:45.394853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d834619a-02eb-42e7-a1b5-bd84ea94460d req-1deafc0d-d1b2-4f56-a6fe-5eb7816c498d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:45.396273 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d834619a-02eb-42e7-a1b5-bd84ea94460d req-1deafc0d-d1b2-4f56-a6fe-5eb7816c498d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0652771 Dec 14 03:18:45.399641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 2ee7b357-17c9-4ac1-be00-9130e426631c completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:18:45.404546 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 2ee7b357-17c9-4ac1-be00-9130e426631c triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:18:45.404921 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:45.460463 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c req-897a304e-e7bb-4027-b9fe-bfa2716debf7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733218 Dec 14 03:18:45.480293 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d834619a-02eb-42e7-a1b5-bd84ea94460d req-d90687db-f4cc-4c51-b1c5-384dc45a1165 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689409 Dec 14 03:18:45.493383 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:45.516793 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:45.519093 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-310796dd-a6fd-4932-84a0-f9a00dc926ad" -d '{"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-plugged", "status": "completed", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:45.531480 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=2ee7b357-17c9-4ac1-be00-9130e426631c,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:45.537011 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:45.563386 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a x-openstack-request-id: req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:45.563670 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-plugged", "status": "completed", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:45.563919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:45.564295 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c', 'code': 200} Dec 14 03:18:45.569932 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 req-5bfbb6fb-6262-4073-988c-6bd10e95b539 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:45.571426 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 req-5bfbb6fb-6262-4073-988c-6bd10e95b539 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0568206 Dec 14 03:18:45.588925 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:45.617988 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 req-8a983090-7818-4489-b0e7-67e5978e4fe9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405712 Dec 14 03:18:45.812942 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bdfe2d3-44dd-418a-9b2d-b9fd31e3853e req-72c3b694-8231-4143-826f-756ff69ca3e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:45.814411 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5bdfe2d3-44dd-418a-9b2d-b9fd31e3853e req-72c3b694-8231-4143-826f-756ff69ca3e0 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 1099 time: 0.0387859 Dec 14 03:18:45.861401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5bdfe2d3-44dd-418a-9b2d-b9fd31e3853e req-ab881569-3e7a-4fde-9111-2e1cb6bf2763 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354626 Dec 14 03:18:46.131965 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 req-0f0a3ebe-7406-4b79-b5b9-7c60b0d1cce9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:46.133971 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 req-0f0a3ebe-7406-4b79-b5b9-7c60b0d1cce9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0573332 Dec 14 03:18:46.179030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 req-7aac032d-57a1-422e-be73-fe66145633b0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393510 Dec 14 03:18:46.597267 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a req-7b7f8030-579e-44c4-8c99-dafa2cbba6e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:46.599262 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a req-7b7f8030-579e-44c4-8c99-dafa2cbba6e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0728784 Dec 14 03:18:46.618926 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f16e5b-f446-42c9-ba41-f4a39676e7be req-4dc94c91-ebc0-445e-abae-505f620c74a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:46.620311 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61f16e5b-f446-42c9-ba41-f4a39676e7be req-4dc94c91-ebc0-445e-abae-505f620c74a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0686429 Dec 14 03:18:46.682372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a req-eaec082a-ff2e-475c-9e3a-012831e086c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767367 Dec 14 03:18:46.693236 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61f16e5b-f446-42c9-ba41-f4a39676e7be req-491b9b78-0baf-4bc9-8482-91fd7581c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0659587 Dec 14 03:18:46.794561 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8385789a-6e62-4754-9b64-a405038c4990 req-b34ac77c-db71-4a47-8fc3-1ad6d65fc509 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:46.796473 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8385789a-6e62-4754-9b64-a405038c4990 req-b34ac77c-db71-4a47-8fc3-1ad6d65fc509 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0596263 Dec 14 03:18:46.842667 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8385789a-6e62-4754-9b64-a405038c4990 req-e7a2ecc7-d037-4f63-992b-117b7558471d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392802 Dec 14 03:18:47.291127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 req-8cba0b89-873e-4600-8f76-08c14d4237f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:47.292564 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 req-8cba0b89-873e-4600-8f76-08c14d4237f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0477409 Dec 14 03:18:47.337895 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 req-50a241af-8992-4289-a520-51405e835db9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396326 Dec 14 03:18:47.822853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9801f722-8073-49a3-83ae-114157c292d5 req-efbe640a-6033-4f56-a1f5-c8ff663458f5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:47.824349 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9801f722-8073-49a3-83ae-114157c292d5 req-efbe640a-6033-4f56-a1f5-c8ff663458f5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0769737 Dec 14 03:18:47.836040 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eda2c6e-f159-4d62-a077-90752f88cb81 req-bdaccd7c-4d6d-4cdc-8ecd-629340f7c2fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:47.837397 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8eda2c6e-f159-4d62-a077-90752f88cb81 req-bdaccd7c-4d6d-4cdc-8ecd-629340f7c2fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0623653 Dec 14 03:18:47.903115 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9801f722-8073-49a3-83ae-114157c292d5 req-bc798f9a-1f08-4087-ba23-9575f0c3eaf0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647764 Dec 14 03:18:47.910429 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8eda2c6e-f159-4d62-a077-90752f88cb81 req-09082047-1a41-480b-854b-b30bc727b27c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0660877 Dec 14 03:18:48.002255 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699e77ef-2071-4e9d-96dd-7213a25a4915 req-b53940cb-f5f2-4a77-8d7c-ae4de16b8f57 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:48.003947 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-699e77ef-2071-4e9d-96dd-7213a25a4915 req-b53940cb-f5f2-4a77-8d7c-ae4de16b8f57 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0482740 Dec 14 03:18:48.051538 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-699e77ef-2071-4e9d-96dd-7213a25a4915 req-6ca263ab-35cc-4577-920c-981db752d029 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419545 Dec 14 03:18:48.448949 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3866f71-1710-4893-a961-56e112e2d3e8 req-7607e5d5-78d8-4984-a4e5-20b5b36927ad tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:48.450376 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d3866f71-1710-4893-a961-56e112e2d3e8 req-7607e5d5-78d8-4984-a4e5-20b5b36927ad tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0465424 Dec 14 03:18:48.496659 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d3866f71-1710-4893-a961-56e112e2d3e8 req-a240f1be-37ae-4939-a67d-d31cc979d036 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403717 Dec 14 03:18:49.044986 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 req-890e5bd0-b63a-4019-8119-e3e2e62887f8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:49.046434 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 req-890e5bd0-b63a-4019-8119-e3e2e62887f8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0780010 Dec 14 03:18:49.057611 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ff216a-abdb-4117-ba3f-13124dc9177b req-2f1ea85a-21d8-4993-a313-8d1dd22a9c19 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:49.058970 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e7ff216a-abdb-4117-ba3f-13124dc9177b req-2f1ea85a-21d8-4993-a313-8d1dd22a9c19 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0659060 Dec 14 03:18:49.128377 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 req-ba7175f5-2dfb-4f13-b9c9-1f0616d2d0a8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683749 Dec 14 03:18:49.132423 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e7ff216a-abdb-4117-ba3f-13124dc9177b req-47ba60ca-f504-4da1-9841-e1d26238c56e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668981 Dec 14 03:18:49.237285 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81303eb4-4193-44ab-a7be-9b97a2ee64bc req-119d233b-b8b3-4f5b-84df-fafd1d52f228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:49.239305 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-81303eb4-4193-44ab-a7be-9b97a2ee64bc req-119d233b-b8b3-4f5b-84df-fafd1d52f228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0471532 Dec 14 03:18:49.287920 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-81303eb4-4193-44ab-a7be-9b97a2ee64bc req-ec689804-a318-4671-a1cd-1ac06837e047 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425546 Dec 14 03:18:49.611444 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb649d4a-6813-4bb2-945c-b28a63a62645 req-4b4855fd-f349-4eca-a7e3-10779e4cc0f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:49.613717 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bb649d4a-6813-4bb2-945c-b28a63a62645 req-4b4855fd-f349-4eca-a7e3-10779e4cc0f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0499671 Dec 14 03:18:49.662409 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-aec72761-28cf-4740-92a6-8091a062f4f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:49.862695 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bb649d4a-6813-4bb2-945c-b28a63a62645 req-573ebeaa-e05b-452d-a168-714b0bc40098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2430854 Dec 14 03:18:50.246853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a req-91a82933-b3f4-4a15-948c-e92e5dbe2699 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:50.248298 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a req-91a82933-b3f4-4a15-948c-e92e5dbe2699 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0467331 Dec 14 03:18:50.294021 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a req-bdb70ec2-89e1-4a05-bed7-51f84fc89225 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394917 Dec 14 03:18:50.401272 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b12453-376a-4355-8906-7819ec3ae3d3 req-19da0a1e-a3ea-4820-9c00-cf4746b46477 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:50.402386 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-83b12453-376a-4355-8906-7819ec3ae3d3 req-19da0a1e-a3ea-4820-9c00-cf4746b46477 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0480094 Dec 14 03:18:50.453370 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-83b12453-376a-4355-8906-7819ec3ae3d3 req-ad8444e0-507d-4c1c-9a2d-76d931afdf1b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449190 Dec 14 03:18:50.976235 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc35e03-57b7-4c38-b7bd-8668282a378b req-b59a2373-9ef8-40bc-abed-a01f04508013 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:50.977754 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5cc35e03-57b7-4c38-b7bd-8668282a378b req-b59a2373-9ef8-40bc-abed-a01f04508013 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0479410 Dec 14 03:18:51.023601 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5cc35e03-57b7-4c38-b7bd-8668282a378b req-e5cff098-2725-409d-8804-a652723959ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397997 Dec 14 03:18:51.267891 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-4adab1a7-c74e-4cc1-81b9-48475d85eef2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:51.269705 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-4adab1a7-c74e-4cc1-81b9-48475d85eef2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.0455339 Dec 14 03:18:51.366234 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Deleting port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:18:51.366594 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:51.482355 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 req-e2cb40fe-5137-43bb-bbd8-0da803457e97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:51.483874 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 req-e2cb40fe-5137-43bb-bbd8-0da803457e97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.1130755 Dec 14 03:18:51.504962 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] For port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:51.505324 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:51.539030 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling delete_port for 9d0f1802-5b85-4dd7-847f-3cdd0b182adf owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:18:51.615779 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 req-5c155106-517d-4779-98e5-39be76645db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1223793 Dec 14 03:18:51.634284 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 req-0bf26975-fe4a-4c68-ad1e-c6f0cbea0d3e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:51.635769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 req-0bf26975-fe4a-4c68-ad1e-c6f0cbea0d3e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/ports?device_id=4687b559-c95a-4b82-a076-a7468c10ebef HTTP/1.1" status: 200 len: 945 time: 0.1142089 Dec 14 03:18:51.700459 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 req-1ea76219-7fc3-46e2-b800-78170d3d54e8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /v2.0/security-groups?id=cb68a42c-409d-4c95-8e71-55975dff464d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577004 Dec 14 03:18:51.751483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:51.779742 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Pushing event deleted for resources: {'Port': ['ID=9d0f1802-5b85-4dd7-847f-3cdd0b182adf,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:51.793169 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9d0f1802-5b85-4dd7-847f-3cdd0b182adf'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:51.823753 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] No DVR routers for this DVR port 9d0f1802-5b85-4dd7-847f-3cdd0b182adf on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:18:51.826673 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:51.830002 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 req-c9eb0621-1880-4f28-8044-42a11ed27904 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.20 "DELETE /v2.0/ports/9d0f1802-5b85-4dd7-847f-3cdd0b182adf HTTP/1.1" status: 204 len: 173 time: 0.5497756 Dec 14 03:18:51.830444 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'name': 'network-vif-deleted', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:51.833295 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fef57ef-7092-4da7-a7ab-fa19c48d6662" -d '{"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-deleted", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:51.866255 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3a9eb43b-d20d-4a4b-9fc3-8eca6c219e96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:51.870373 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f x-openstack-request-id: req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:51.870761 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-deleted", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:51.871256 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:51.871659 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4687b559-c95a-4b82-a076-a7468c10ebef', 'name': 'network-vif-deleted', 'tag': '9d0f1802-5b85-4dd7-847f-3cdd0b182adf', 'status': 'completed', 'code': 200} Dec 14 03:18:52.136634 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e7f4756-9a82-409e-9531-164e063deea9 req-f06b4f80-7a60-40d7-b6e6-d147c03c675d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:52.138065 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8e7f4756-9a82-409e-9531-164e063deea9 req-f06b4f80-7a60-40d7-b6e6-d147c03c675d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0476224 Dec 14 03:18:52.183172 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8e7f4756-9a82-409e-9531-164e063deea9 req-af6e252d-0bd7-462f-b619-44530243cbfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392733 Dec 14 03:18:52.736429 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 req-1cb717a7-88b9-4cbd-824a-f907bbb3cdaf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:52.738275 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 req-1cb717a7-88b9-4cbd-824a-f907bbb3cdaf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0483432 Dec 14 03:18:52.756086 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53740) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:52.786738 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 req-6cb179c4-940f-4f57-94de-b29cf75406f0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425339 Dec 14 03:18:53.303582 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 req-a607339a-7dfc-471b-8d8f-75325ea53f0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:53.305084 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 req-a607339a-7dfc-471b-8d8f-75325ea53f0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0529451 Dec 14 03:18:53.353163 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 req-991b051f-ad6b-452d-8e2d-3b649ae6908b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420799 Dec 14 03:18:53.394903 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.418248 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:18:53.512642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:53.523654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:18:53.559607 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.581858 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:18:53.598696 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.606702 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:53.610379 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.656264 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=6']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:53.683435 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Deleting port 1b9553c4-78d4-462f-a94a-3ea34b003fd3 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:18:53.683776 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.759066 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] For port 1b9553c4-78d4-462f-a94a-3ea34b003fd3, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1b9553c4-78d4-462f-a94a-3ea34b003fd3,segment=NetworkSegment(63d17698-aa5e-4fb8-873f-d90c459e1bf5),segment_id=63d17698-aa5e-4fb8-873f-d90c459e1bf5)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:53.759776 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.771652 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Calling delete_port for 1b9553c4-78d4-462f-a94a-3ea34b003fd3 owned by network:router_interface {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:18:53.862492 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['85ceb16f-0c27-48e9-ab76-5cd49eb12802'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:18:53.908640 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500e7afd-703a-4ec9-b132-1e09b162ab48 req-08cec10f-531f-45bc-a18b-eecd125c7f35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:53.909436 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-500e7afd-703a-4ec9-b132-1e09b162ab48 req-08cec10f-531f-45bc-a18b-eecd125c7f35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0515878 Dec 14 03:18:53.962191 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:53.976548 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-500e7afd-703a-4ec9-b132-1e09b162ab48 req-b4d65148-01fb-4176-9f54-0d3350dd9331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525198 Dec 14 03:18:54.000111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=1b9553c4-78d4-462f-a94a-3ea34b003fd3,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:54.146420 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.348468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Router 5e9dc0da-1e5d-4792-b837-a8f826984a14 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:18:54.455251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:18:54.460551 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-4e68f65e-e865-4930-a13f-7cf8cc5537c5 admin admin] 10.222.0.43 "PUT /v2.0/routers/5e9dc0da-1e5d-4792-b837-a8f826984a14/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7034211 Dec 14 03:18:54.462945 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53752) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:54.465728 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Sync routers for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:18:54.482299 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:18:54.483132 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b62cd887-ac26-47ab-baeb-d53ec303903f req-756530f2-363a-4fa1-9bfc-d9c33183c4df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:54.483894 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:18:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:54.484720 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b62cd887-ac26-47ab-baeb-d53ec303903f req-756530f2-363a-4fa1-9bfc-d9c33183c4df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0605080 Dec 14 03:18:54.537929 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b62cd887-ac26-47ab-baeb-d53ec303903f req-19418698-cc2d-4ab4-ae11-10f55c9b44bc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465889 Dec 14 03:18:54.568555 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.573964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.600518 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:18:54.672481 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.721732 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Deleting port a0d1af4b-c83d-4269-869f-8940b01220a7 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:18:54.722599 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.776462 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:18:53Z', 'revision_number': 5, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port': {'id': 'a0d1af4b-c83d-4269-869f-8940b01220a7', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:46:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:54.797834 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] For port a0d1af4b-c83d-4269-869f-8940b01220a7, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=a0d1af4b-c83d-4269-869f-8940b01220a7,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:54.798421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.803218 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Checking router: 5e9dc0da-1e5d-4792-b837-a8f826984a14 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:18:54.810186 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Calling delete_port for a0d1af4b-c83d-4269-869f-8940b01220a7 owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:18:54.811261 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Routers {'5e9dc0da-1e5d-4792-b837-a8f826984a14'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:18:54.811870 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:18:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5e9dc0da-1e5d-4792-b837-a8f826984a14'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:54.973738 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:54.974190 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] Set router 5e9dc0da-1e5d-4792-b837-a8f826984a14 gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:18:55.003737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Pushing event deleted for resources: {'Port': ['ID=a0d1af4b-c83d-4269-869f-8940b01220a7,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:55.031805 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:18:54Z', 'revision_number': 6, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:55.059959 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c239a478-3376-406b-b542-79fcd2e12657 None None] The sync data for ids ['5e9dc0da-1e5d-4792-b837-a8f826984a14'] in dv-cinder-818037-8-iscsi is: [{'id': '5e9dc0da-1e5d-4792-b837-a8f826984a14', 'name': 'tempest-ServerRescueNegativeTestJSON-638528978-router', 'tenant_id': 'bb4be946dd9b4b2080fb3b398521624e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:18:54Z', 'revision_number': 6, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'gw_port_host': None}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:18:55.071613 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.115836 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 req-41669786-cf11-4f81-a98c-bfec25aad4b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:55.117307 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 req-41669786-cf11-4f81-a98c-bfec25aad4b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0599432 Dec 14 03:18:55.163436 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 req-ada861c6-c311-4817-a9fb-3ad263afa4c2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402994 Dec 14 03:18:55.172635 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.174872 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.237494 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.238310 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5e9dc0da-1e5d-4792-b837-a8f826984a14 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:18:55.243248 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.244401 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-023d240e-26b0-4f4e-8f17-2ce21f6f8b10 admin admin] 10.222.0.43 "DELETE /v2.0/routers/5e9dc0da-1e5d-4792-b837-a8f826984a14 HTTP/1.1" status: 204 len: 168 time: 0.7802958 Dec 14 03:18:55.246775 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53758) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:55.292979 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Deleting subnet 2088257b-adb7-490f-afb9-fe03d7b4ad30 {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:18:55.295973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.328195 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.365267 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.418489 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.442070 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:18:55.442304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2088257b-adb7-490f-afb9-fe03d7b4ad30,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:55.447967 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.451216 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7ca8ee04-c2f0-44f5-8ddb-54669964b098 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/2088257b-adb7-490f-afb9-fe03d7b4ad30 HTTP/1.1" status: 204 len: 168 time: 0.2034614 Dec 14 03:18:55.453692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53760) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:55.492855 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:18:55.493145 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.527653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.574426 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.601118 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:18:55.603356 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8b38b43-0705-418c-95c3-15ec5ef38c9f" -d '{"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:18:55.608316 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.616512 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:18:55.621445 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.622413 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9d0f1802-5b85-4dd7-847f-3cdd0b182adf no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:18:55.632292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4af40aa-6be1-48c2-866d-05aa1bdec9d3']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:55.642183 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63d17698-aa5e-4fb8-873f-d90c459e1bf5') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:55.642486 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63d17698-aa5e-4fb8-873f-d90c459e1bf5') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:18:55.654676 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.664297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:18:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-109019f8-1f4d-45a8-ba95-14f592feda01 x-openstack-request-id: req-109019f8-1f4d-45a8-ba95-14f592feda01 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:18:55.664297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:18:55.664637 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-109019f8-1f4d-45a8-ba95-14f592feda01 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:18:55.664997 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'code': 200} Dec 14 03:18:55.665510 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 9d0f1802-5b85-4dd7-847f-3cdd0b182adf {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:18:55.665851 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9d0f1802-5b85-4dd7-847f-3cdd0b182adf not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:18:55.669391 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f833963-0b20-413b-b8ed-9cf47b599bd4 req-e2c7eea9-b80a-4a9d-988a-b57eee9a0a51 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:55.677612 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.677937 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f833963-0b20-413b-b8ed-9cf47b599bd4 req-e2c7eea9-b80a-4a9d-988a-b57eee9a0a51 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0628710 Dec 14 03:18:55.684331 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Releasing vlan 277 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:18:55.684836 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:18:55.686564 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:18:55.702105 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=7']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:55.725952 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f833963-0b20-413b-b8ed-9cf47b599bd4 req-8b9bcf08-0f89-4421-86d3-ae5d450b59c0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472291 Dec 14 03:18:55.740748 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.745233 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.749096 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] 10.222.0.43 "DELETE /v2.0/networks/b4af40aa-6be1-48c2-866d-05aa1bdec9d3 HTTP/1.1" status: 204 len: 168 time: 0.2941234 Dec 14 03:18:55.762273 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d42a59-2613-498a-8d93-244ced956848 admin admin] Pushing event deleted for resources: {'Network': ['ID=b4af40aa-6be1-48c2-866d-05aa1bdec9d3,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:55.789722 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:55.913519 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 53768) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:55.954134 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-897a581a-d11c-4189-b3cb-8366a4df9835 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bb4be946dd9b4b2080fb3b398521624e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0394635 Dec 14 03:18:55.956648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 53770) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:18:56.001854 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:56.024656 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:56.083595 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:56.086260 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:18:56.087453 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cb68a42c-409d-4c95-8e71-55975dff464d HTTP/1.1" status: 204 len: 168 time: 0.1299126 Dec 14 03:18:56.096002 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a83f980-e0fc-4b02-abc1-c169e0235933 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb68a42c-409d-4c95-8e71-55975dff464d,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:18:56.289974 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 req-6f69049f-b62c-4ac9-8ea4-1f74edfb87d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:56.291492 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 req-6f69049f-b62c-4ac9-8ea4-1f74edfb87d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0527997 Dec 14 03:18:56.343675 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 req-1737e43b-3de7-4ed4-b9ef-aa656f4c28f5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461385 Dec 14 03:18:56.466799 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1b9553c4-78d4-462f-a94a-3ea34b003fd3 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:18:56.486599 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 1b9553c4-78d4-462f-a94a-3ea34b003fd3 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:18:56.486935 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1b9553c4-78d4-462f-a94a-3ea34b003fd3 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:18:56.487361 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device a0d1af4b-c83d-4269-869f-8940b01220a7 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:18:56.508148 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: a0d1af4b-c83d-4269-869f-8940b01220a7 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:18:56.508412 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device a0d1af4b-c83d-4269-869f-8940b01220a7 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:18:56.842417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a req-e52f9324-7f57-4a46-a903-923b4cff548c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:56.843959 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a req-e52f9324-7f57-4a46-a903-923b4cff548c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0497222 Dec 14 03:18:56.892282 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a req-c203bef4-21f9-4ed4-85dd-7228f395d3d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424440 Dec 14 03:18:57.477869 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2107fcff-8d1a-430b-9aa2-f90191d2a618 req-8cb87c86-88fa-40db-bf91-5e613dc6cbf3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:57.479398 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2107fcff-8d1a-430b-9aa2-f90191d2a618 req-8cb87c86-88fa-40db-bf91-5e613dc6cbf3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0495183 Dec 14 03:18:57.527458 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2107fcff-8d1a-430b-9aa2-f90191d2a618 req-5e8c46eb-417f-4a3d-b722-0a97eb690e5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417974 Dec 14 03:18:58.008882 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b042918b-9448-4c61-8e5e-a7bb16156f6b req-3bccdea8-e22e-489b-8c92-22dd3391ba4d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:58.010321 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b042918b-9448-4c61-8e5e-a7bb16156f6b req-3bccdea8-e22e-489b-8c92-22dd3391ba4d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0509796 Dec 14 03:18:58.058808 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b042918b-9448-4c61-8e5e-a7bb16156f6b req-be3fc3cb-d6a9-44bc-b772-ea1e40261fac tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421448 Dec 14 03:18:58.657200 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19fbadb-7235-42f9-ba0e-47895133377b req-e541f706-3271-4392-bb4d-746f59bf855a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:58.660067 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e19fbadb-7235-42f9-ba0e-47895133377b req-e541f706-3271-4392-bb4d-746f59bf855a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0506513 Dec 14 03:18:58.712997 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e19fbadb-7235-42f9-ba0e-47895133377b req-b8f26032-61a8-45fd-b92a-68171f04ccd0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474718 Dec 14 03:18:59.182044 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeffee3b-e346-41bb-bef5-d62b356b836c req-a1f4798b-b9ca-46ce-b287-5d2f752f9d15 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.183846 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aeffee3b-e346-41bb-bef5-d62b356b836c req-a1f4798b-b9ca-46ce-b287-5d2f752f9d15 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0543756 Dec 14 03:18:59.240568 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aeffee3b-e346-41bb-bef5-d62b356b836c req-49874aba-c299-4919-8957-bd211b8fca6e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487249 Dec 14 03:18:59.488403 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7588111-db1f-4a8d-aaed-38b20d94ce1f req-b989e02b-5b3d-46e8-adc1-cec48041c9b4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.490292 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7588111-db1f-4a8d-aaed-38b20d94ce1f req-b989e02b-5b3d-46e8-adc1-cec48041c9b4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0525653 Dec 14 03:18:59.630620 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7588111-db1f-4a8d-aaed-38b20d94ce1f req-13156139-b72e-464e-b3d6-cce8180dfe0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1255932 Dec 14 03:18:59.643704 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48004bc9-d195-452d-80d2-aa9f43117324 req-43b5d3e9-75d3-43b9-8b74-f9f96356658b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.645593 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-43b5d3e9-75d3-43b9-8b74-f9f96356658b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.1083872 Dec 14 03:18:59.773664 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48004bc9-d195-452d-80d2-aa9f43117324 req-a664a749-aa92-4362-b083-131b5546d53a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.776034 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-a664a749-aa92-4362-b083-131b5546d53a service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.1193249 Dec 14 03:18:59.882117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-5dc7714a-c25e-43ff-98de-79a17ddd7f6f service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 1001 time: 0.0958023 Dec 14 03:18:59.902745 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 req-52807301-43a7-4879-a312-d5fb6d11e994 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.904378 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 req-52807301-43a7-4879-a312-d5fb6d11e994 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0804369 Dec 14 03:18:59.972933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48004bc9-d195-452d-80d2-aa9f43117324 req-5e2121df-e521-4140-af63-fdfaa6a38b08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:18:59.974606 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-5e2121df-e521-4140-af63-fdfaa6a38b08 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0803146 Dec 14 03:18:59.997412 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 req-dc697b87-7be2-420e-8379-137daf04ef69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0852442 Dec 14 03:19:00.044390 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48004bc9-d195-452d-80d2-aa9f43117324 req-30746438-689f-4a76-9f50-a9fdf0af3a85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:00.045915 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-30746438-689f-4a76-9f50-a9fdf0af3a85 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0615487 Dec 14 03:19:00.176661 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-5371415b-e54d-4af9-9483-d855fd297a50 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1222315 Dec 14 03:19:00.324925 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-48004bc9-d195-452d-80d2-aa9f43117324 req-61411923-f11d-4de7-99a7-4b87f15d5d72 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1402898 Dec 14 03:19:00.564644 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53926) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:00.714550 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c085db9e-26c1-4412-9a61-8fa61fb97c50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:00.827379 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c085db9e-26c1-4412-9a61-8fa61fb97c50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:00.828217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 req-7d514d61-b5af-49b4-ba75-3667346881d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:00.830627 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 req-7d514d61-b5af-49b4-ba75-3667346881d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0997441 Dec 14 03:19:00.838361 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c085db9e-26c1-4412-9a61-8fa61fb97c50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:00.876295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c085db9e-26c1-4412-9a61-8fa61fb97c50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf9e5dbb-91bc-4f97-add4-4909ec737c1a,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:00.913500 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c085db9e-26c1-4412-9a61-8fa61fb97c50 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=440ec90268da41da8dbb69474818976d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3477323 Dec 14 03:19:00.914176 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53940) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:00.947571 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 req-75bdd0c3-7df5-4bd1-82a0-3939fb7d92cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1059780 Dec 14 03:19:00.986962 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.010427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.063914 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.073353 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.088654 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/bf9e5dbb-91bc-4f97-add4-4909ec737c1a HTTP/1.1" status: 204 len: 168 time: 0.1719167 Dec 14 03:19:01.103858 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a4d9bf9-093f-4491-8324-d577146f21b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf9e5dbb-91bc-4f97-add4-4909ec737c1a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:01.167853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55580f3-a129-4feb-8fac-87e9da33f438 req-bf20e988-0479-4021-b6cc-d6867d2ef76a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:01.169779 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c55580f3-a129-4feb-8fac-87e9da33f438 req-bf20e988-0479-4021-b6cc-d6867d2ef76a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0572257 Dec 14 03:19:01.226430 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c55580f3-a129-4feb-8fac-87e9da33f438 req-236b0778-f8b8-4703-a382-692a0243097b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493414 Dec 14 03:19:01.594425 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53948) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:01.611725 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-062c9e07-f746-4bad-8f8d-3d526e3b22ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.715511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-062c9e07-f746-4bad-8f8d-3d526e3b22ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.720168 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-062c9e07-f746-4bad-8f8d-3d526e3b22ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.775077 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062c9e07-f746-4bad-8f8d-3d526e3b22ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1dd96af0-ea4c-4dcd-8575-50c666b9bce0,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:01.779562 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-062c9e07-f746-4bad-8f8d-3d526e3b22ea admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1a1de7e955aa4197bab1ac8cc3e28ba9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1834717 Dec 14 03:19:01.782101 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 53950) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:01.840707 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.863690 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.912295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.915127 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:01.916336 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1dd96af0-ea4c-4dcd-8575-50c666b9bce0 HTTP/1.1" status: 204 len: 168 time: 0.1333313 Dec 14 03:19:01.925170 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9e038d-0f0c-4e4f-88cb-4c003fbc3127 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1dd96af0-ea4c-4dcd-8575-50c666b9bce0,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:02.125368 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 req-8ebc62a0-3c45-4498-933b-c78498484736 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:02.133913 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 req-8ebc62a0-3c45-4498-933b-c78498484736 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0937662 Dec 14 03:19:02.206916 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 req-b7248315-9af5-495f-b5d1-464b3e9a204a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720634 Dec 14 03:19:02.295103 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad0ff25-5815-4cba-bdd7-73cd3670b65f req-4a497dfd-8579-4be1-8a04-0663423a3542 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:02.302461 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bad0ff25-5815-4cba-bdd7-73cd3670b65f req-4a497dfd-8579-4be1-8a04-0663423a3542 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0693107 Dec 14 03:19:02.416878 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bad0ff25-5815-4cba-bdd7-73cd3670b65f req-2798f498-0f17-4d8d-8c44-057ebc2f172f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134481 Dec 14 03:19:02.431113 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 req-e7f16c93-4ce8-426e-80aa-9543715eaa79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:02.432718 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 req-e7f16c93-4ce8-426e-80aa-9543715eaa79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0918982 Dec 14 03:19:02.504643 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 req-3fa0d8d2-d0dd-4212-a758-bdb90dfaa980 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542712 Dec 14 03:19:03.585333 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1291f1f-4d94-4345-a1ea-37c886692b7c req-af278490-f02a-4cd5-a68c-e9b296218723 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:03.594944 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1291f1f-4d94-4345-a1ea-37c886692b7c req-af278490-f02a-4cd5-a68c-e9b296218723 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0892735 Dec 14 03:19:03.683786 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1291f1f-4d94-4345-a1ea-37c886692b7c req-dde53e34-4559-4d28-b0ac-755830278734 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877287 Dec 14 03:19:03.714255 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b089e9c-15f9-4385-845e-1e36e7d4168c req-369a63aa-20d8-4dee-baf4-dc0bcfb13758 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:03.716727 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b089e9c-15f9-4385-845e-1e36e7d4168c req-369a63aa-20d8-4dee-baf4-dc0bcfb13758 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0910676 Dec 14 03:19:03.778132 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b089e9c-15f9-4385-845e-1e36e7d4168c req-1e05c6b8-5f4b-465a-8c9d-8e835b97364d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535440 Dec 14 03:19:04.697681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-2e37f7fa-4683-4079-b047-4faa5f26167b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:04.699198 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-2e37f7fa-4683-4079-b047-4faa5f26167b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0536819 Dec 14 03:19:04.845793 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb32c-8433-4f9a-ac9b-53bc68b890ab req-c6b003b0-ff6d-4802-89a0-45103a171312 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:04.847410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27efb32c-8433-4f9a-ac9b-53bc68b890ab req-c6b003b0-ff6d-4802-89a0-45103a171312 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 946 time: 0.0876625 Dec 14 03:19:04.865285 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Deleting port 2ee7b357-17c9-4ac1-be00-9130e426631c {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:19:04.865623 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:05.017293 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d req-ccc9d3ec-ebd5-4501-ac6e-e20c1fd52c1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:05.018703 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d req-ccc9d3ec-ebd5-4501-ac6e-e20c1fd52c1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.1617868 Dec 14 03:19:05.025469 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-27efb32c-8433-4f9a-ac9b-53bc68b890ab req-1737c5a5-a6af-46d2-86c2-3bd09469d1ca tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1705267 Dec 14 03:19:05.065156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] For port 2ee7b357-17c9-4ac1-be00-9130e426631c, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=2ee7b357-17c9-4ac1-be00-9130e426631c,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:19:05.065815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:05.091259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling delete_port for 2ee7b357-17c9-4ac1-be00-9130e426631c owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:19:05.111018 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d req-f16ae630-f818-4bb1-b6ae-958b36515c39 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845475 Dec 14 03:19:05.253355 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:05.297328 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', '9ffbafb8-f71a-4067-8988-a284fbb41603', 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', '2ee7b357-17c9-4ac1-be00-9130e426631c'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:19:05.321995 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event deleted for resources: {'Port': ['ID=2ee7b357-17c9-4ac1-be00-9130e426631c,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:05.360457 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] No DVR routers for this DVR port 2ee7b357-17c9-4ac1-be00-9130e426631c on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:19:05.364453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:05.367994 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 req-61adc1de-e9c9-4296-a2a8-69560418a827 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "DELETE /v2.0/ports/2ee7b357-17c9-4ac1-be00-9130e426631c HTTP/1.1" status: 204 len: 173 time: 0.6611972 Dec 14 03:19:05.368536 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'name': 'network-vif-deleted', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:19:05.375350 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15fee516-7897-4219-8271-83de0884b75b" -d '{"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-deleted", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:19:05.436697 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:19:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd x-openstack-request-id: req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:19:05.437192 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-deleted", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:19:05.437652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:19:05.439157 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10269bb5-0ad1-46fb-b4a2-62e573eb2dcd', 'name': 'network-vif-deleted', 'tag': '2ee7b357-17c9-4ac1-be00-9130e426631c', 'status': 'completed', 'code': 200} Dec 14 03:19:06.138930 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 req-39dc26bf-2cf9-4ae6-9382-63716c5af636 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=10269bb5-0ad1-46fb-b4a2-62e573eb2dcd HTTP/1.1" status: 200 len: 210 time: 0.0269771 Dec 14 03:19:06.265080 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d56226-f514-45e5-844b-7f47ea1bf77c req-2018c680-3f3f-4990-aa6d-c51beeed1cd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:06.266804 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14d56226-f514-45e5-844b-7f47ea1bf77c req-2018c680-3f3f-4990-aa6d-c51beeed1cd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0512109 Dec 14 03:19:06.318016 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14d56226-f514-45e5-844b-7f47ea1bf77c req-67b240c1-b58e-488c-b246-038fa4e562dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444095 Dec 14 03:19:07.452648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e666cc6-667d-4798-9eb4-f07baec03f5c req-0f5a26f0-4557-42c7-80cc-9e68f17e0d1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:07.454864 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3e666cc6-667d-4798-9eb4-f07baec03f5c req-0f5a26f0-4557-42c7-80cc-9e68f17e0d1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0579491 Dec 14 03:19:07.515292 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3e666cc6-667d-4798-9eb4-f07baec03f5c req-96250e84-6fa6-4abf-9520-45fae4934914 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505705 Dec 14 03:19:08.637413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa7c2f10-eaab-499e-a312-da3f833cb666 req-ae0740e2-ba49-4db9-9c74-592bef7dd232 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:08.640344 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa7c2f10-eaab-499e-a312-da3f833cb666 req-ae0740e2-ba49-4db9-9c74-592bef7dd232 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0551879 Dec 14 03:19:08.699878 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa7c2f10-eaab-499e-a312-da3f833cb666 req-5fb2c37d-d717-42e4-b713-d34e226fcd84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542827 Dec 14 03:19:09.816557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 req-94c29e05-9f56-44f1-986f-103504efd3b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:09.817982 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 req-94c29e05-9f56-44f1-986f-103504efd3b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0463860 Dec 14 03:19:09.866229 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 req-17d4d3d3-41a8-4f32-a454-29cc1caff9fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423706 Dec 14 03:19:10.418031 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 2ee7b357-17c9-4ac1-be00-9130e426631c no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:19:10.438149 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 2ee7b357-17c9-4ac1-be00-9130e426631c {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:19:10.438495 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 2ee7b357-17c9-4ac1-be00-9130e426631c not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:19:10.984470 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cba7e68-b090-4979-8f2a-3c147eea2f76 req-2dfd5305-98a8-47cf-bfb0-0b9a0c31b681 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:10.985829 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3cba7e68-b090-4979-8f2a-3c147eea2f76 req-2dfd5305-98a8-47cf-bfb0-0b9a0c31b681 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0475965 Dec 14 03:19:11.031814 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3cba7e68-b090-4979-8f2a-3c147eea2f76 req-ced101f9-42c4-435f-afd7-5e9a8c111f70 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398023 Dec 14 03:19:11.191529 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:11.729498 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4557183-680e-46c5-b685-d20ad9a28cb0 req-1f19b7ad-e83c-4e6d-aee8-60b876b84398 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:11.731034 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4557183-680e-46c5-b685-d20ad9a28cb0 req-1f19b7ad-e83c-4e6d-aee8-60b876b84398 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0504537 Dec 14 03:19:11.778394 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4557183-680e-46c5-b685-d20ad9a28cb0 req-529a0284-a863-432d-ab08-ebd5e30898a9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413620 Dec 14 03:19:12.073435 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-c4196682-0868-4b27-bc2f-f1885bffbd4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:12.074953 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-c4196682-0868-4b27-bc2f-f1885bffbd4c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1098 time: 0.0428967 Dec 14 03:19:12.198495 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ee8283-4085-41c4-a781-66c02314d206 req-95c4dd5a-8fe1-40bc-a56a-ae7d9f7ecd19 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:12.199955 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-44ee8283-4085-41c4-a781-66c02314d206 req-95c4dd5a-8fe1-40bc-a56a-ae7d9f7ecd19 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0741222 Dec 14 03:19:12.204326 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-11ba0da0-0cf0-49fb-b736-365a434d8821 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:12.205621 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-11ba0da0-0cf0-49fb-b736-365a434d8821 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.1223106 Dec 14 03:19:12.287716 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-44ee8283-4085-41c4-a781-66c02314d206 req-dd66bc1a-baf2-4afa-8bee-39732da22c16 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0806341 Dec 14 03:19:12.295280 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-99b6b2c9-a032-41cd-a791-0d3a37decaa7 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 1000 time: 0.0761180 Dec 14 03:19:12.344157 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-2899f406-81b4-4e36-bb5d-0bfa47e799c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:12.345496 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-2899f406-81b4-4e36-bb5d-0bfa47e799c4 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0424516 Dec 14 03:19:12.897648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc req-4bb78ec3-a8ff-4551-87f7-e458a1a5075f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:12.899119 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc req-4bb78ec3-a8ff-4551-87f7-e458a1a5075f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0523922 Dec 14 03:19:12.944114 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc req-8c2a5bc5-32aa-47cd-a6d0-e34046bff3c4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391159 Dec 14 03:19:13.405199 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4feb43b7-d7a4-4b41-a73a-3a1981717cca req-4409826f-2c2a-4dc8-82f0-19375d9ada2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:13.406659 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4feb43b7-d7a4-4b41-a73a-3a1981717cca req-4409826f-2c2a-4dc8-82f0-19375d9ada2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0486195 Dec 14 03:19:13.452547 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4feb43b7-d7a4-4b41-a73a-3a1981717cca req-06c83144-6e1e-46d0-9e76-aee8d1a6e588 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394671 Dec 14 03:19:14.055951 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98dc466-6247-4a5c-b2d0-77fb900eb857 req-a56f3822-f26f-4e57-893b-a0f6b0a8dba5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:14.057387 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d98dc466-6247-4a5c-b2d0-77fb900eb857 req-a56f3822-f26f-4e57-893b-a0f6b0a8dba5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0466585 Dec 14 03:19:14.105746 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d98dc466-6247-4a5c-b2d0-77fb900eb857 req-e726638a-24a2-4606-aa72-ea5cd623916d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424163 Dec 14 03:19:14.571186 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 req-19039a32-222b-440e-b5d5-d6b16028780a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:14.572634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 req-19039a32-222b-440e-b5d5-d6b16028780a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0471833 Dec 14 03:19:14.618132 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 req-bdb28b28-4a19-4627-98e2-63d1800945d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395586 Dec 14 03:19:14.805416 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-782474e6-c2dc-41e6-a50a-525fcd714547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:14.806766 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-782474e6-c2dc-41e6-a50a-525fcd714547 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392120 Dec 14 03:19:15.217207 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 req-286ff1f6-bc6e-4fc5-9e74-7090cd181d38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:15.218663 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 req-286ff1f6-bc6e-4fc5-9e74-7090cd181d38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0490282 Dec 14 03:19:15.263623 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 req-d6d8f7b5-7b69-4ef4-85bd-2d1c398b1568 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385349 Dec 14 03:19:15.747872 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d req-ce8c95d2-11c9-468e-831b-71d4738f44b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:15.749340 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d req-ce8c95d2-11c9-468e-831b-71d4738f44b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 945 time: 0.0506954 Dec 14 03:19:15.795486 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d req-a37c17c3-5312-4497-a8f9-40787cb81f3f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400021 Dec 14 03:19:16.276212 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:19:16.358131 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:16.382019 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:19:16.384597 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb568efc-7047-4bab-a552-3bda4202da92" -d '{"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-unplugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:19:16.397831 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:19:16.403295 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:16.427445 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 14 Dec 2021 03:19:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35c65af5-7b1b-46e6-95b4-f295dac756fe x-openstack-request-id: req-35c65af5-7b1b-46e6-95b4-f295dac756fe {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:19:16.427726 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-unplugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:19:16.427984 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-35c65af5-7b1b-46e6-95b4-f295dac756fe {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:19:16.428374 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'code': 200} Dec 14 03:19:16.453557 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=8']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:16.453768 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-051e4d99-b6f5-4b04-b842-40703186f8b2 req-c5d88b8c-0cbf-4ce7-8f94-261476eafb38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:16.455486 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-051e4d99-b6f5-4b04-b842-40703186f8b2 req-c5d88b8c-0cbf-4ce7-8f94-261476eafb38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0717139 Dec 14 03:19:16.478006 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-4b9ea0bb-23ac-40ba-b412-94f28c5100d0 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3491173 Dec 14 03:19:16.546791 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-051e4d99-b6f5-4b04-b842-40703186f8b2 req-aaa26fe7-ba1b-4bbc-ae6b-d9f5a3f19863 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844436 Dec 14 03:19:16.584737 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8594db4c-4dd7-457b-a634-c539bfd07f98 req-6b7f5790-a6b0-4b68-a726-9bf1d41d9f3b service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946815 Dec 14 03:19:16.913933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d req-a70cec06-19b9-4884-9f14-fbddb97b169c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:16.915378 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d req-a70cec06-19b9-4884-9f14-fbddb97b169c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0476060 Dec 14 03:19:16.960841 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d req-39710261-2c1b-41a5-9529-19179ce6213b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396564 Dec 14 03:19:17.657501 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 req-df8f1d79-fa20-46ba-8e7d-ca01d5f776e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:17.659884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 req-df8f1d79-fa20-46ba-8e7d-ca01d5f776e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0472894 Dec 14 03:19:17.712085 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 req-5dd30a08-04f1-4ec4-acdb-28827156c4dc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470443 Dec 14 03:19:18.030643 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-d969b8d2-1873-4f52-8216-1ec54e12efba tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:18.032182 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-d969b8d2-1873-4f52-8216-1ec54e12efba tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 946 time: 0.0529923 Dec 14 03:19:18.144127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4111aec-4c64-4212-a521-f05d49efdfe0 req-98b7febc-f749-40ca-96c0-6acdb58b99ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:18.145608 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4111aec-4c64-4212-a521-f05d49efdfe0 req-98b7febc-f749-40ca-96c0-6acdb58b99ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0981169 Dec 14 03:19:18.191053 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Deleting port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:19:18.191392 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:18.215399 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b4111aec-4c64-4212-a521-f05d49efdfe0 req-d7b759c4-6452-448a-b159-5aa908402445 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0637612 Dec 14 03:19:18.285726 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] For port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:19:18.286011 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:18.297440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling delete_port for fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:19:18.432807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:18.465533 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event deleted for resources: {'Port': ['ID=fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:18.469520 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', '9ffbafb8-f71a-4067-8988-a284fbb41603', 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:19:18.505136 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] No DVR routers for this DVR port fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:19:18.507624 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:18.510955 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c641f87-4df8-44ee-836f-efde5b616bfc req-1e32776b-f11d-420e-b79d-d0251b8174c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "DELETE /v2.0/ports/fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b HTTP/1.1" status: 204 len: 173 time: 0.4709406 Dec 14 03:19:18.511428 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'name': 'network-vif-deleted', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:19:18.513664 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9721fc7e-4581-460f-8c38-166a26cc4e98" -d '{"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-deleted", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:19:18.555210 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:19:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 x-openstack-request-id: req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:19:18.555502 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-deleted", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:19:18.555756 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:19:18.556152 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '095d132d-1529-4a41-a033-a8b41a1af328', 'name': 'network-vif-deleted', 'tag': 'fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b', 'status': 'completed', 'code': 200} Dec 14 03:19:18.812479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a9a7c666-06d2-4523-8406-8bb56cee4b1f req-b0e59b7b-1be3-411c-a101-4442b469b866 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=095d132d-1529-4a41-a033-a8b41a1af328 HTTP/1.1" status: 200 len: 210 time: 0.0253742 Dec 14 03:19:19.000314 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:19:19.347261 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89db5595-457e-4ac5-bfd2-8239aa2dd031 req-5547570f-b12a-4872-b1cc-51553bfc1f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:19.348835 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-89db5595-457e-4ac5-bfd2-8239aa2dd031 req-5547570f-b12a-4872-b1cc-51553bfc1f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0542607 Dec 14 03:19:19.400141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-89db5595-457e-4ac5-bfd2-8239aa2dd031 req-a1a0c2cc-a170-4453-9da7-d345c24a9ecc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450282 Dec 14 03:19:19.666810 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02ee8f04-3ae7-46c5-a0ff-bde746784302 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:19.872422 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-32f0033b-c3cd-47a5-8ad8-5084e9a285e4 req-f3710f3f-6de6-46ae-9f10-8d08d3445d1c service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:19:19.873405 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32f0033b-c3cd-47a5-8ad8-5084e9a285e4 req-f3710f3f-6de6-46ae-9f10-8d08d3445d1c service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054715 Dec 14 03:19:20.031500 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f3e210-fc32-4022-ba6b-b146f97d000e req-bb9bb3f4-f822-430d-ac44-37878e2874e4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:20.033318 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-88f3e210-fc32-4022-ba6b-b146f97d000e req-bb9bb3f4-f822-430d-ac44-37878e2874e4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0551629 Dec 14 03:19:20.110636 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b1c1d3-8b5f-455c-8b8b-662b06389116 req-d1049902-45a5-482f-bceb-5159014a7a53 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:20.112281 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-60b1c1d3-8b5f-455c-8b8b-662b06389116 req-d1049902-45a5-482f-bceb-5159014a7a53 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0773602 Dec 14 03:19:20.117447 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-88f3e210-fc32-4022-ba6b-b146f97d000e req-0da811a8-0de6-481a-867d-21447500aaeb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747056 Dec 14 03:19:20.165637 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-60b1c1d3-8b5f-455c-8b8b-662b06389116 req-4105c7fe-27f6-45b4-8471-2267153c292f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466721 Dec 14 03:19:20.398735 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54206) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:20.480089 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-f9a8079e-be76-4ce2-8acf-574f3fa0c210 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0801287 Dec 14 03:19:20.488746 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-53c2ccc8-34d7-479e-bfa0-0a021e4991fa service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:19:20.489666 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-53c2ccc8-34d7-479e-bfa0-0a021e4991fa service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049736 Dec 14 03:19:21.237580 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c437f8-4682-4136-b8b8-663a4ad0d80a req-28bcb3ac-758e-4749-afe3-829b956466a7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:21.239317 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61c437f8-4682-4136-b8b8-663a4ad0d80a req-28bcb3ac-758e-4749-afe3-829b956466a7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0467355 Dec 14 03:19:21.314475 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e553caf1-6621-4911-ab62-1695d28bf446 req-5002f84d-24b2-461c-866a-8818fddef5e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:21.316493 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e553caf1-6621-4911-ab62-1695d28bf446 req-5002f84d-24b2-461c-866a-8818fddef5e7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0762556 Dec 14 03:19:21.320730 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61c437f8-4682-4136-b8b8-663a4ad0d80a req-54fb2633-e046-4d8b-b768-7b156e6aa27b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0728457 Dec 14 03:19:21.361358 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e553caf1-6621-4911-ab62-1695d28bf446 req-80d6d49e-33b0-4e5c-9231-578294ddc557 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390954 Dec 14 03:19:21.858760 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c344ee44-728d-4cd1-aee0-b9e77b20d07a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:22.447316 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466c2729-f77c-49f9-b3b7-44599257abae req-493edba6-be59-4cd8-9b4e-7cc58104c2ce tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:22.448734 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-466c2729-f77c-49f9-b3b7-44599257abae req-493edba6-be59-4cd8-9b4e-7cc58104c2ce tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0562389 Dec 14 03:19:22.515509 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bcdc26-8703-4cf0-88f1-264432b271d1 req-4613e7b0-e31c-46e2-96f0-1737d423e086 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:22.516927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12bcdc26-8703-4cf0-88f1-264432b271d1 req-4613e7b0-e31c-46e2-96f0-1737d423e086 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0879614 Dec 14 03:19:22.521739 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-466c2729-f77c-49f9-b3b7-44599257abae req-a23da32e-616a-401b-8ed2-b57eb02c07c9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598965 Dec 14 03:19:22.564358 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12bcdc26-8703-4cf0-88f1-264432b271d1 req-da1894b0-4f58-4f02-a41a-e23b375c5349 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407372 Dec 14 03:19:23.579754 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:23.648574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ff60c7-1601-4d3f-9995-84f2232239b0 req-d6ad41fb-7775-48d5-ac12-1d15f63e5364 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:23.649987 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-49ff60c7-1601-4d3f-9995-84f2232239b0 req-d6ad41fb-7775-48d5-ac12-1d15f63e5364 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0570519 Dec 14 03:19:23.709574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 req-1bd0b4e2-7bad-4fb5-b1b3-e60c06ff7af4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:23.711069 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 req-1bd0b4e2-7bad-4fb5-b1b3-e60c06ff7af4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0780890 Dec 14 03:19:23.739216 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-49ff60c7-1601-4d3f-9995-84f2232239b0 req-b01f4b41-1c7c-4b73-9885-eb32c86d19e1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726118 Dec 14 03:19:23.771326 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 req-01e4f913-e9ff-48c5-a993-ba21f36d9e43 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509799 Dec 14 03:19:24.563453 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:24.897428 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 req-d35e2e76-887d-4006-b5a2-05de478e224f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:24.898914 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 req-d35e2e76-887d-4006-b5a2-05de478e224f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0749867 Dec 14 03:19:24.919516 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3768292-cb41-4e37-bd87-4228a2230713 req-43da620b-c770-4213-bf52-ae86a644c8f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:24.920952 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3768292-cb41-4e37-bd87-4228a2230713 req-43da620b-c770-4213-bf52-ae86a644c8f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0720704 Dec 14 03:19:24.979123 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 req-3e059cca-9475-4c64-8d9e-9809a613eee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731814 Dec 14 03:19:24.993208 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3768292-cb41-4e37-bd87-4228a2230713 req-2b8ac127-b2b3-4373-9197-ead8f4ba8e1b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647624 Dec 14 03:19:25.324603 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:19:25.397537 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:19:25.415492 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:19:25.415833 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:19:25.794651 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:26.127995 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909f866b-e9b5-4666-9302-3c13a46f7da6 req-a76dc3ad-ad9e-4855-a8be-fad8d0d3c145 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:26.129460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-909f866b-e9b5-4666-9302-3c13a46f7da6 req-a76dc3ad-ad9e-4855-a8be-fad8d0d3c145 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0783479 Dec 14 03:19:26.136649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1c2aba-93f1-4d7d-a494-390c31641f19 req-6baf28b5-bc5b-468f-a9ee-d437e8c46c3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:26.137981 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7b1c2aba-93f1-4d7d-a494-390c31641f19 req-6baf28b5-bc5b-468f-a9ee-d437e8c46c3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0782862 Dec 14 03:19:26.210648 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-909f866b-e9b5-4666-9302-3c13a46f7da6 req-54d7cb06-67c8-4870-ad49-fbc459c55ef7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717332 Dec 14 03:19:26.214002 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7b1c2aba-93f1-4d7d-a494-390c31641f19 req-496aa0e1-c5c3-440b-986e-f47295f46fd5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692205 Dec 14 03:19:27.054334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-5e71421c-36ee-40b4-a2af-5bf30ac09572 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.055817 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-5e71421c-36ee-40b4-a2af-5bf30ac09572 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.0496838 Dec 14 03:19:27.158058 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Deleting port 9ffbafb8-f71a-4067-8988-a284fbb41603 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:19:27.158765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:27.246904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-456f8259-140c-4410-b711-b6fd927b6dc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.247366 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] For port 9ffbafb8-f71a-4067-8988-a284fbb41603, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9ffbafb8-f71a-4067-8988-a284fbb41603,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:19:27.247504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:27.248854 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-456f8259-140c-4410-b711-b6fd927b6dc4 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 1096 time: 0.0740952 Dec 14 03:19:27.261130 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling delete_port for 9ffbafb8-f71a-4067-8988-a284fbb41603 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:19:27.327015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-b7e2ece9-aa35-42f3-8868-42ff11eb4f4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.328532 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-b7e2ece9-aa35-42f3-8868-42ff11eb4f4f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1096 time: 0.0402038 Dec 14 03:19:27.419619 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 req-c8f08d02-19f3-4546-9d0f-fd2df03a0e4f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.420621 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-6bd3adca-7385-40ee-a984-f886f038af54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.421104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 req-c8f08d02-19f3-4546-9d0f-fd2df03a0e4f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1043675 Dec 14 03:19:27.422219 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-6bd3adca-7385-40ee-a984-f886f038af54 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0864799 Dec 14 03:19:27.429987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eaa127f-2279-4dac-a8ad-97440124b403 req-0408f21d-dc43-454f-b936-a90898f9f63a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:27.431384 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9eaa127f-2279-4dac-a8ad-97440124b403 req-0408f21d-dc43-454f-b936-a90898f9f63a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 945 time: 0.1135540 Dec 14 03:19:27.487515 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-04f073d6-0954-4092-946c-e02b7631a12a service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 998 time: 0.0567248 Dec 14 03:19:27.547491 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 req-9fca9005-1be9-4447-9add-a2c6b983062d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1143906 Dec 14 03:19:27.551890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9eaa127f-2279-4dac-a8ad-97440124b403 req-8d62d357-d4ef-4ede-8621-d69c387ae7de tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114893 Dec 14 03:19:27.552241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:27.580628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event deleted for resources: {'Port': ['ID=9ffbafb8-f71a-4067-8988-a284fbb41603,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:27.624339 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] No DVR routers for this DVR port 9ffbafb8-f71a-4067-8988-a284fbb41603 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:19:27.626819 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:27.630169 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d46fe16-3d7d-4624-8b08-ceed929eb159 req-64b97a15-09ae-4ee7-9456-b429503381b7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "DELETE /v2.0/ports/9ffbafb8-f71a-4067-8988-a284fbb41603 HTTP/1.1" status: 204 len: 173 time: 0.5665367 Dec 14 03:19:27.630605 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'name': 'network-vif-deleted', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:19:27.632843 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55242e43-1439-47a0-92a2-15a06e2d9994" -d '{"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-deleted", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:19:27.667527 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:19:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00646582-5300-4268-966e-d39fc5006bbd x-openstack-request-id: req-00646582-5300-4268-966e-d39fc5006bbd {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:19:27.667824 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-deleted", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:19:27.668079 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-00646582-5300-4268-966e-d39fc5006bbd {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:19:27.668476 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe', 'name': 'network-vif-deleted', 'tag': '9ffbafb8-f71a-4067-8988-a284fbb41603', 'status': 'completed', 'code': 200} Dec 14 03:19:28.653013 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-63be7675-9067-4622-8193-82a606454f9e req-ca6fb283-188a-40c3-a8fa-292e256076ee tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0320389 Dec 14 03:19:28.687666 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0013cb-cb4a-42f7-90df-a463e8805da2 req-e0cc38a7-85ba-4cf9-b215-5117d7f7bc91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:28.689023 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4b0013cb-cb4a-42f7-90df-a463e8805da2 req-e0cc38a7-85ba-4cf9-b215-5117d7f7bc91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0596569 Dec 14 03:19:28.735169 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4b0013cb-cb4a-42f7-90df-a463e8805da2 req-ea5493c0-03a3-4325-bf87-12ca5c385817 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401025 Dec 14 03:19:29.119697 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-f88e2d59-4515-4f7a-9a60-e952d2dbbb6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:29.121102 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-f88e2d59-4515-4f7a-9a60-e952d2dbbb6c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0451365 Dec 14 03:19:29.746070 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2385b5be-2e41-4f7c-ba81-b0514087e14b req-76e6dc38-2d13-46b3-a69d-7831887813cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0254450 Dec 14 03:19:29.854676 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ee05a5-514b-4a54-82a9-9847b9085316 req-cc6031ea-b568-4427-a748-1b98397f4ed2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:29.856146 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-34ee05a5-514b-4a54-82a9-9847b9085316 req-cc6031ea-b568-4427-a748-1b98397f4ed2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0501192 Dec 14 03:19:29.901132 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-34ee05a5-514b-4a54-82a9-9847b9085316 req-aad8596a-16f3-4c33-8590-3d43aac5b6ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391681 Dec 14 03:19:30.836498 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 req-0557ed8a-f767-484d-9717-23a826deb086 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0261474 Dec 14 03:19:31.070848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271e970e-27bd-4f23-9fa8-011432d18543 req-7244f80b-657f-481c-8740-224e93435858 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:31.072329 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-271e970e-27bd-4f23-9fa8-011432d18543 req-7244f80b-657f-481c-8740-224e93435858 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1001489 Dec 14 03:19:31.118030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-271e970e-27bd-4f23-9fa8-011432d18543 req-b356918b-be9c-42cc-a7e9-c95b4e3cd619 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396929 Dec 14 03:19:31.368190 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-ce4a0edb-6ad8-4722-b05b-fbde109945c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:31.369566 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-ce4a0edb-6ad8-4722-b05b-fbde109945c1 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0455678 Dec 14 03:19:31.373639 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:19:31.400268 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9ffbafb8-f71a-4067-8988-a284fbb41603 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:19:31.429280 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 9ffbafb8-f71a-4067-8988-a284fbb41603 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:19:31.429911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9ffbafb8-f71a-4067-8988-a284fbb41603 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:19:31.476905 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-79c50ebb-6db3-4b74-9f22-3cfec4e4e430 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894728 Dec 14 03:19:31.817354 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e req-59e85532-778d-497f-9057-de277c9fe73c service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3247457 Dec 14 03:19:31.943378 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c08aec46-1f2e-4e39-b161-9c11027db33f req-66144d61-6734-4492-95af-f5077dc17f4e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe HTTP/1.1" status: 200 len: 210 time: 0.0265336 Dec 14 03:19:32.239304 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8034033b-9fe6-4271-9494-c6134e00c91b req-490cb6cc-cdbb-495f-b177-23a8bfbe5f09 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:32.240820 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8034033b-9fe6-4271-9494-c6134e00c91b req-490cb6cc-cdbb-495f-b177-23a8bfbe5f09 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0530157 Dec 14 03:19:32.287708 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8034033b-9fe6-4271-9494-c6134e00c91b req-e6a97de4-1cb4-4239-9cf1-9021d0588202 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411510 Dec 14 03:19:33.423290 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3058a16-55a2-4f16-b9d3-a53414334947 req-11f360db-48c9-4bf0-87a5-732568e54377 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:33.425394 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a3058a16-55a2-4f16-b9d3-a53414334947 req-11f360db-48c9-4bf0-87a5-732568e54377 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0495508 Dec 14 03:19:33.472796 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a3058a16-55a2-4f16-b9d3-a53414334947 req-06c1e8cb-9ce5-4334-828c-d64cf550a3fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412533 Dec 14 03:19:34.344077 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a req-88e7917b-8ee6-42cb-86e7-96a76060e40a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:34.345550 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a req-88e7917b-8ee6-42cb-86e7-96a76060e40a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0524178 Dec 14 03:19:34.394112 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a req-d7313e2e-e19a-49f4-9e33-9fe36da3cde8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420465 Dec 14 03:19:34.672550 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed12a69d-d0c7-4aca-ac41-443d139b757a req-88bbd69a-c551-4803-aec7-ffbd38a34415 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:34.674973 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed12a69d-d0c7-4aca-ac41-443d139b757a req-88bbd69a-c551-4803-aec7-ffbd38a34415 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.1159282 Dec 14 03:19:34.727569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ed12a69d-d0c7-4aca-ac41-443d139b757a req-7d6c7e09-56b9-48c2-b329-598e1bc6af38 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462186 Dec 14 03:19:35.517129 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 req-c10ed33a-2fde-443d-934d-7b920a038235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:35.525000 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 req-c10ed33a-2fde-443d-934d-7b920a038235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0568891 Dec 14 03:19:35.576230 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 req-951bea69-d2b9-4b7b-bf70-e7bd25e0a320 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503695 Dec 14 03:19:35.854589 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 req-921393e5-4c31-4680-b987-c6065d4675de tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:35.856122 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 req-921393e5-4c31-4680-b987-c6065d4675de tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0532944 Dec 14 03:19:35.904430 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 req-bbf26cc5-d588-4ace-9135-528bc6815d85 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424027 Dec 14 03:19:36.692495 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77810c10-4ae6-4d3f-83bc-45861fe3525e req-9b5db726-4f59-4377-ba66-5a9d93c58fb2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:36.693877 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77810c10-4ae6-4d3f-83bc-45861fe3525e req-9b5db726-4f59-4377-ba66-5a9d93c58fb2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0517640 Dec 14 03:19:36.740556 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77810c10-4ae6-4d3f-83bc-45861fe3525e req-eeebc971-ed4c-4c01-8527-944ca4f8d7d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407004 Dec 14 03:19:37.060485 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb req-ae318c3e-1b04-48f8-97b6-0fa36b7f53a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:37.062116 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb req-ae318c3e-1b04-48f8-97b6-0fa36b7f53a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0691092 Dec 14 03:19:37.110991 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb req-66b70d38-9571-4239-9c15-ef45a42d3778 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428474 Dec 14 03:19:37.854253 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9801c705-2bef-4c3f-bb7f-285e9f19e313 req-6a4acd18-0857-4d10-94b8-4ced6a198d0e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:37.855759 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9801c705-2bef-4c3f-bb7f-285e9f19e313 req-6a4acd18-0857-4d10-94b8-4ced6a198d0e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0483916 Dec 14 03:19:37.903647 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9801c705-2bef-4c3f-bb7f-285e9f19e313 req-62868c8d-b791-4a69-ae8c-8de03d1ea120 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412514 Dec 14 03:19:38.230322 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f652be76-b62c-4a58-bfe3-4fc23657b3cb req-c1941df4-9bd4-46fd-93b8-b6a12a197fea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:38.231704 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f652be76-b62c-4a58-bfe3-4fc23657b3cb req-c1941df4-9bd4-46fd-93b8-b6a12a197fea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0463490 Dec 14 03:19:38.280472 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f652be76-b62c-4a58-bfe3-4fc23657b3cb req-af7ac3dc-5118-45fe-b536-ce26ef4d9a43 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422981 Dec 14 03:19:39.014789 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86082b68-9584-4d11-95b6-b27de8af415a req-bff4a17b-1572-4141-b157-307e3cc0c060 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:39.016260 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-86082b68-9584-4d11-95b6-b27de8af415a req-bff4a17b-1572-4141-b157-307e3cc0c060 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0476227 Dec 14 03:19:39.060950 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-86082b68-9584-4d11-95b6-b27de8af415a req-ee63bd4f-e236-4551-a730-dc10b2faa9f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382831 Dec 14 03:19:39.402863 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692e9c87-b14d-457e-87fb-c1d730269f89 req-3ed16e3f-5f32-423f-9687-0f57850312f6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:39.404365 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-692e9c87-b14d-457e-87fb-c1d730269f89 req-3ed16e3f-5f32-423f-9687-0f57850312f6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0499332 Dec 14 03:19:39.454018 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-692e9c87-b14d-457e-87fb-c1d730269f89 req-1694ebf2-45f4-4c6b-bc65-79790015fe93 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431364 Dec 14 03:19:40.178536 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c48bdc3-4e61-42f5-9be5-05533c008829 req-fde5a0ff-984f-4e84-ade7-b6c85ede99c9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:40.180378 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c48bdc3-4e61-42f5-9be5-05533c008829 req-fde5a0ff-984f-4e84-ade7-b6c85ede99c9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0518844 Dec 14 03:19:40.233259 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c48bdc3-4e61-42f5-9be5-05533c008829 req-c143fd9d-88dc-4cd4-8b5e-8e61b0b8a10f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407369 Dec 14 03:19:40.576586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec req-873d6dbc-0ddc-40ec-9cbe-34237294eaed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:40.578101 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec req-873d6dbc-0ddc-40ec-9cbe-34237294eaed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0505099 Dec 14 03:19:40.627841 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec req-d92ff592-4361-46d6-b578-d4acd98f7145 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435524 Dec 14 03:19:41.184899 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:41.348747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e0e5d4-7fc0-46be-bca9-8165664449cf req-600b4a2d-83ae-4669-9f94-337418f88f1b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:41.350175 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-03e0e5d4-7fc0-46be-bca9-8165664449cf req-600b4a2d-83ae-4669-9f94-337418f88f1b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0503156 Dec 14 03:19:41.396579 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-03e0e5d4-7fc0-46be-bca9-8165664449cf req-0c5ead71-db33-4471-a164-1f37b510e15e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404530 Dec 14 03:19:41.745462 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8173dd3-167e-41a2-99c2-8612f32c6282 req-f983712c-df62-4a8c-b84c-e30fe2107821 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:41.746906 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8173dd3-167e-41a2-99c2-8612f32c6282 req-f983712c-df62-4a8c-b84c-e30fe2107821 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0470300 Dec 14 03:19:41.792381 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8173dd3-167e-41a2-99c2-8612f32c6282 req-9e9c4b4a-115f-43c4-9bf3-dfda3b9d6248 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390725 Dec 14 03:19:42.506773 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d66994b-ab55-470b-8ecf-9b016593861b req-49e07fd3-5bf9-40c4-8e78-f5b4a6fb00dc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:42.508242 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d66994b-ab55-470b-8ecf-9b016593861b req-49e07fd3-5bf9-40c4-8e78-f5b4a6fb00dc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0468588 Dec 14 03:19:42.555379 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d66994b-ab55-470b-8ecf-9b016593861b req-6015de28-c92e-42a2-84e7-fd18559df889 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414145 Dec 14 03:19:42.911323 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51dddd0-c463-4a1d-9c21-24c46deed997 req-c2da82aa-4f31-4346-843b-c97aee69dabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:42.912745 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a51dddd0-c463-4a1d-9c21-24c46deed997 req-c2da82aa-4f31-4346-843b-c97aee69dabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0480099 Dec 14 03:19:42.957568 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a51dddd0-c463-4a1d-9c21-24c46deed997 req-b704722a-3178-4ede-805b-eac272960683 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390208 Dec 14 03:19:43.668267 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53288a7f-a739-4368-9880-ba13e659b91b req-1244a1e0-94f1-40ba-8b2b-60664c03424d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:43.669733 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53288a7f-a739-4368-9880-ba13e659b91b req-1244a1e0-94f1-40ba-8b2b-60664c03424d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0474806 Dec 14 03:19:43.715555 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53288a7f-a739-4368-9880-ba13e659b91b req-6116cad6-ea79-4316-9368-59a8d320e1cb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395434 Dec 14 03:19:44.083352 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16f6981-90b3-454a-b876-3efe0f61d3a9 req-fd43e723-1816-4c51-b21d-67f76dc72ce3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:44.084801 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d16f6981-90b3-454a-b876-3efe0f61d3a9 req-fd43e723-1816-4c51-b21d-67f76dc72ce3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0515201 Dec 14 03:19:44.132835 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d16f6981-90b3-454a-b876-3efe0f61d3a9 req-e46280cc-7f24-4b2e-b9cb-9a439a5962b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419714 Dec 14 03:19:44.830092 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac243b78-280c-437a-a102-ffe6b7a73814 req-f9b3fc23-ff27-465d-8fdc-66977d1bdee5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:44.831637 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ac243b78-280c-437a-a102-ffe6b7a73814 req-f9b3fc23-ff27-465d-8fdc-66977d1bdee5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0475147 Dec 14 03:19:44.884113 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ac243b78-280c-437a-a102-ffe6b7a73814 req-7ed6fdab-cf09-452a-9c37-5e9502f59d12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441508 Dec 14 03:19:45.255949 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 req-4daaf67f-da11-4408-ab54-f9e19307e9bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:45.257367 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 req-4daaf67f-da11-4408-ab54-f9e19307e9bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0479665 Dec 14 03:19:45.317860 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 req-69e36259-d423-437c-820e-b6756c33d5dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545821 Dec 14 03:19:45.993555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 req-ce261528-1cab-4bcb-9cef-7161ef7571c9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:45.995004 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 req-ce261528-1cab-4bcb-9cef-7161ef7571c9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0476432 Dec 14 03:19:46.041187 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 req-b6b04272-8172-4c6f-a9f9-2dfa38492e71 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402212 Dec 14 03:19:46.435002 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c req-9f964009-e032-410e-822e-2a7398295d7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:46.436476 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c req-9f964009-e032-410e-822e-2a7398295d7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0474315 Dec 14 03:19:46.482959 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c req-0b05cf7f-08bb-4412-95e1-461ca780db8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393584 Dec 14 03:19:47.156703 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1216764-7713-45c2-8032-79accfb48971 req-c23d99f4-9c4f-4f1f-9c76-248de2156755 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:47.158139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1216764-7713-45c2-8032-79accfb48971 req-c23d99f4-9c4f-4f1f-9c76-248de2156755 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0502043 Dec 14 03:19:47.203314 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1216764-7713-45c2-8032-79accfb48971 req-9e9e5e65-baef-4b78-acc5-b1a4085336a2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388441 Dec 14 03:19:47.605241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 req-81b0fb48-3269-4e08-81ec-ecd752c4ef66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:47.607025 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 req-81b0fb48-3269-4e08-81ec-ecd752c4ef66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0526936 Dec 14 03:19:47.660660 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 req-58880b05-42db-4fdb-a562-a1f24bd59d2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463080 Dec 14 03:19:48.319991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 req-94d6e995-1b9c-4a66-be76-cce4bfcd6a17 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:48.321510 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 req-94d6e995-1b9c-4a66-be76-cce4bfcd6a17 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0513978 Dec 14 03:19:48.381667 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 req-738d594d-7125-4eed-bfb3-c84158a2a8d6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428805 Dec 14 03:19:48.794376 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84072162-0af2-4331-91b5-a3aabc6ad184 req-b0420022-5fe7-4c42-8824-9c83e1f9f7fe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:48.795966 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84072162-0af2-4331-91b5-a3aabc6ad184 req-b0420022-5fe7-4c42-8824-9c83e1f9f7fe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0550790 Dec 14 03:19:48.854728 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-84072162-0af2-4331-91b5-a3aabc6ad184 req-1a840b1b-fa35-4273-8c4b-218a0fe26086 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520816 Dec 14 03:19:49.494401 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e150b298-fb6d-4a84-bea8-5a14f813c1cf req-c5cbed06-0fea-4905-8635-a9c11076dfac tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:49.495913 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e150b298-fb6d-4a84-bea8-5a14f813c1cf req-c5cbed06-0fea-4905-8635-a9c11076dfac tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0486662 Dec 14 03:19:49.558122 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e150b298-fb6d-4a84-bea8-5a14f813c1cf req-87627b0f-f526-4280-9987-efa42dbc4b50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528240 Dec 14 03:19:49.673638 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5244119-e6fc-434a-88a2-66d8f3e3cdfc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:49.978114 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 req-84a33fba-1ec3-4f69-88e5-d5aedf1c93ea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:49.979634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 req-84a33fba-1ec3-4f69-88e5-d5aedf1c93ea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0528572 Dec 14 03:19:50.026810 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 req-890861b7-ee6a-45d9-bb4f-af1638a5f399 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411167 Dec 14 03:19:50.667079 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-615fcd63-9317-43b4-8203-56a9d1876d68 req-4bdad6a0-fd9c-4708-ac67-027cf38a8a9b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:50.668728 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-615fcd63-9317-43b4-8203-56a9d1876d68 req-4bdad6a0-fd9c-4708-ac67-027cf38a8a9b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0522108 Dec 14 03:19:50.723213 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-615fcd63-9317-43b4-8203-56a9d1876d68 req-5fbf9f64-d19f-41cd-b5f5-1c71c0f83912 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443804 Dec 14 03:19:51.252442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ca300b-ad37-464c-9d1f-6e64f5205633 req-961ff559-3eca-427d-8440-a84d3b287bb5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:51.254087 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b5ca300b-ad37-464c-9d1f-6e64f5205633 req-961ff559-3eca-427d-8440-a84d3b287bb5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0545802 Dec 14 03:19:51.302573 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b5ca300b-ad37-464c-9d1f-6e64f5205633 req-f4d89e12-e0d6-47c8-a46c-c7fc02dfca09 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419462 Dec 14 03:19:51.838293 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87495e44-d020-4b2c-9c2e-88f6b1497699 req-8e64f532-9fbb-4619-af3f-3d6aea4f5fa7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:51.839708 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-87495e44-d020-4b2c-9c2e-88f6b1497699 req-8e64f532-9fbb-4619-af3f-3d6aea4f5fa7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0514975 Dec 14 03:19:51.859954 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0bf56a1f-a12a-4483-919a-558a99f868fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:51.887565 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-87495e44-d020-4b2c-9c2e-88f6b1497699 req-89bb456e-c6fc-43ea-b18b-15067e75d694 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420003 Dec 14 03:19:52.429339 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 req-9760f3bb-c5d2-42a3-88b7-1faf7783cc37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:52.430973 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 req-9760f3bb-c5d2-42a3-88b7-1faf7783cc37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0547345 Dec 14 03:19:52.481793 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 req-609611a9-d546-4fe9-bdef-e3aab0b254ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449123 Dec 14 03:19:53.012058 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4128c4-278b-4750-952f-9b03bf48812c req-63d46458-86f2-48fd-8727-57dee61e84d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:53.020849 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cc4128c4-278b-4750-952f-9b03bf48812c req-63d46458-86f2-48fd-8727-57dee61e84d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0565526 Dec 14 03:19:53.067137 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cc4128c4-278b-4750-952f-9b03bf48812c req-1950ec1f-6ee6-46bc-8307-b52d8143a6b0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448587 Dec 14 03:19:53.586776 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:53.614798 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb40d456-2990-4a03-9c66-fcda1cbddddc req-23f618f2-915d-4e44-8405-1c33d7ebde8b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:53.616271 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb40d456-2990-4a03-9c66-fcda1cbddddc req-23f618f2-915d-4e44-8405-1c33d7ebde8b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0583396 Dec 14 03:19:53.663536 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb40d456-2990-4a03-9c66-fcda1cbddddc req-f77eab34-4a21-470e-847f-0125351c6888 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414197 Dec 14 03:19:54.084113 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54522) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:54.199048 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 req-d92ad012-e4e8-4c10-a246-f680de9cd16b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:54.201460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 req-d92ad012-e4e8-4c10-a246-f680de9cd16b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0636151 Dec 14 03:19:54.201877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.259733 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 req-2541af20-aa21-46e2-9c7e-2c4cb7fa1252 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510130 Dec 14 03:19:54.285719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.289537 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.326662 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f937350c93bc4d4290e99e19c2ea2d70&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2415919 Dec 14 03:19:54.327642 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4825d41d-e039-4716-bb9c-a3332c68c5f6,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:54.329367 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54528) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:54.335222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.335511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.335857 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.336197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.336528 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.336855 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.337182 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.337510 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.337837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.338176 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.338500 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.338819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.339165 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-336a9508-946c-4cdd-b598-a8e18909bf1a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.378413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.402052 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.447704 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.450299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.451479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4825d41d-e039-4716-bb9c-a3332c68c5f6 HTTP/1.1" status: 204 len: 168 time: 0.1210706 Dec 14 03:19:54.459333 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4825d41d-e039-4716-bb9c-a3332c68c5f6,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:54.466394 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.466747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.467112 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.467450 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.467783 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.468164 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.468499 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.468899 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.469143 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.469468 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.469795 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.470120 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.470437 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba22555d-2402-455c-ad3b-ed9c6b1923d4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:19:54.570524 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.706353 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54536) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:54.719032 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-774b3c89-651b-4c4b-927a-1be374703633 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.821372 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14010277-d458-4b9a-84f3-31d9d6871b71 req-5c37b58a-019a-4cb1-a70e-0bfd72df7f69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:54.822821 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14010277-d458-4b9a-84f3-31d9d6871b71 req-5c37b58a-019a-4cb1-a70e-0bfd72df7f69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0762100 Dec 14 03:19:54.841456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-774b3c89-651b-4c4b-927a-1be374703633 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.849033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-774b3c89-651b-4c4b-927a-1be374703633 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.904315 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-774b3c89-651b-4c4b-927a-1be374703633 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fa764459cc0b4544bd81a9fb59608133&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1968317 Dec 14 03:19:54.906968 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54538) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:19:54.907616 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-774b3c89-651b-4c4b-927a-1be374703633 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c69aa4df-24be-43d4-a2ca-591a5bf684db,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:54.914367 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-14010277-d458-4b9a-84f3-31d9d6871b71 req-573a2947-1c69-44e3-a76e-67f32e0f2cf8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0843039 Dec 14 03:19:54.954111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:54.973877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:55.018631 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:55.021467 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:55.022822 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c69aa4df-24be-43d4-a2ca-591a5bf684db HTTP/1.1" status: 204 len: 168 time: 0.1146636 Dec 14 03:19:55.030394 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e92fc4-a38d-4b9a-b115-dbcf8d4e4387 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c69aa4df-24be-43d4-a2ca-591a5bf684db,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:55.371452 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b req-63847345-252e-4c2f-984e-0385a4af3da7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:55.372948 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b req-63847345-252e-4c2f-984e-0385a4af3da7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0499108 Dec 14 03:19:55.421503 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b req-dc271b44-4691-4c45-b97d-e88e667ab802 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418785 Dec 14 03:19:55.801563 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:55.999098 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:19:56.040197 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c req-832ef1c7-9bbf-4045-9e24-598199ddfef2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:56.041691 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c req-832ef1c7-9bbf-4045-9e24-598199ddfef2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0526466 Dec 14 03:19:56.090137 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c req-3073d7da-9553-489a-9ac5-cac771c2c892 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425050 Dec 14 03:19:56.537417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfcae91-eede-4fc6-b5f4-7be37edce602 req-cf114d64-9ec6-42fd-9072-2c1f3a5bbc1b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:56.538937 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbfcae91-eede-4fc6-b5f4-7be37edce602 req-cf114d64-9ec6-42fd-9072-2c1f3a5bbc1b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0492940 Dec 14 03:19:56.597601 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbfcae91-eede-4fc6-b5f4-7be37edce602 req-4ad8685c-3d9f-41c1-adbd-44b127e1e625 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517356 Dec 14 03:19:56.686154 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-07082ab8-a4e7-41ff-b013-e68bcf379502 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1558352 Dec 14 03:19:56.759737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-5697dec8-9966-4e58-9284-25de499ba9dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:56.761207 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-5697dec8-9966-4e58-9284-25de499ba9dc service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.0414121 Dec 14 03:19:56.878516 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-7a7c7fd5-4cf0-463d-b9fa-4c5b5dd9ad5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:56.880021 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-7a7c7fd5-4cf0-463d-b9fa-4c5b5dd9ad5d service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.0927958 Dec 14 03:19:56.947462 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-405e4392-1a66-4406-a2b7-e708ff2732ae service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 1001 time: 0.0586748 Dec 14 03:19:56.995801 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-015e2e5c-98d4-47dc-8776-4a5b5c36eda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:56.997077 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-015e2e5c-98d4-47dc-8776-4a5b5c36eda7 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0409248 Dec 14 03:19:57.042966 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-187981b1-f68b-48c4-96bb-df52160a2ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:57.044444 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-187981b1-f68b-48c4-96bb-df52160a2ec8 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0375869 Dec 14 03:19:57.136523 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-f6542130-43ba-4399-b4a4-925879d4d060 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836453 Dec 14 03:19:57.213328 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 req-15efce75-8a29-4bab-aab1-3e7d303bbbcb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:57.214797 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 req-15efce75-8a29-4bab-aab1-3e7d303bbbcb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0512478 Dec 14 03:19:57.229450 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a08a048a-7e2a-4ba7-bc64-111cd5a8284c req-178f7341-fed9-402f-b11c-f7d40f776e0c service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845385 Dec 14 03:19:57.261913 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 req-d88d3176-f16c-4d86-968e-e2556a1b61bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410776 Dec 14 03:19:57.711844 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ecd247-31fe-4337-87e2-e6125ecf2a56 req-fac9b2c5-80ee-4974-b994-84ab6c404ae3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:57.713323 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61ecd247-31fe-4337-87e2-e6125ecf2a56 req-fac9b2c5-80ee-4974-b994-84ab6c404ae3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0484502 Dec 14 03:19:57.763312 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-61ecd247-31fe-4337-87e2-e6125ecf2a56 req-31f712d8-4a82-4830-a965-2d171b33badf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440192 Dec 14 03:19:58.378441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9ed400-6649-420e-8ddf-66485d3fec84 req-ab2ba824-467a-4786-b2df-f54ab71ba912 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:58.380410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cc9ed400-6649-420e-8ddf-66485d3fec84 req-ab2ba824-467a-4786-b2df-f54ab71ba912 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0470080 Dec 14 03:19:58.429515 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cc9ed400-6649-420e-8ddf-66485d3fec84 req-9ea2b55b-354c-4d3b-9213-c9f521324271 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433521 Dec 14 03:19:58.876904 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 req-13081ff4-7016-46e1-a9ab-e657095e9ddc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:58.879352 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 req-13081ff4-7016-46e1-a9ab-e657095e9ddc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0475669 Dec 14 03:19:58.923517 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 req-5894898b-0ef0-4312-99af-b2bfc110c66b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/security-groups?id=a8c9bd0d-623a-43f5-95cb-d6df61f221ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386314 Dec 14 03:19:59.112589 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170e5f6f-1d34-456b-bb76-bc665216786d req-3d92f341-ed2f-4034-880f-365e1722cea7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:59.114882 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-170e5f6f-1d34-456b-bb76-bc665216786d req-3d92f341-ed2f-4034-880f-365e1722cea7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 945 time: 0.0524054 Dec 14 03:19:59.204241 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Deleting port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:19:59.204591 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:59.297864 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] For port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,segment=NetworkSegment(36876166-6080-44fb-9026-20129e125f6e),segment_id=36876166-6080-44fb-9026-20129e125f6e)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:19:59.298217 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:59.310137 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling delete_port for b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:19:59.431089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:59.462906 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Pushing event deleted for resources: {'Port': ['ID=b60f528b-8a43-4d0c-83ea-77e6e41b0fe5,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:19:59.466125 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:19:59.507027 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] No DVR routers for this DVR port b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:19:59.509572 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:19:59.513149 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-170e5f6f-1d34-456b-bb76-bc665216786d req-a8b4e482-e1c5-4703-a8e4-db3c420e9e2c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.20 "DELETE /v2.0/ports/b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 HTTP/1.1" status: 204 len: 173 time: 0.3919888 Dec 14 03:19:59.513559 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'name': 'network-vif-deleted', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:19:59.516078 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9469b902-ac84-49fd-b898-affe330847e8" -d '{"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-deleted", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:19:59.572230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9170397a-a66d-485d-bccd-ecdd3192e4aa req-6deb8c37-a1cd-493d-9326-5b286ecfa6f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:19:59.579340 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9170397a-a66d-485d-bccd-ecdd3192e4aa req-6deb8c37-a1cd-493d-9326-5b286ecfa6f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0588815 Dec 14 03:19:59.626415 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9170397a-a66d-485d-bccd-ecdd3192e4aa req-fb978204-12c4-4368-ad34-f5548aee86aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457804 Dec 14 03:19:59.702858 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:19:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1352e6f4-8d1d-4194-90ed-d230fd319f0e x-openstack-request-id: req-1352e6f4-8d1d-4194-90ed-d230fd319f0e {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:19:59.703179 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-deleted", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:19:59.703432 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1352e6f4-8d1d-4194-90ed-d230fd319f0e {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:19:59.703825 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de04da40-f5fd-43e2-b454-20a219642030', 'name': 'network-vif-deleted', 'tag': 'b60f528b-8a43-4d0c-83ea-77e6e41b0fe5', 'status': 'completed', 'code': 200} Dec 14 03:20:00.032216 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-604d4a9c-0384-4c07-b72f-ae9475f14c01 req-6f041aea-fed1-4401-9d36-91c40cb6a443 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /v2.0/ports?device_id=de04da40-f5fd-43e2-b454-20a219642030 HTTP/1.1" status: 200 len: 210 time: 0.0294945 Dec 14 03:20:00.655348 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54646) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:00.747466 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f76215d-d21e-400b-bd75-eb374d39cee5 req-f7a81a29-8591-4a71-8d3f-81fa8f831c97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:00.748960 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f76215d-d21e-400b-bd75-eb374d39cee5 req-f7a81a29-8591-4a71-8d3f-81fa8f831c97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0487666 Dec 14 03:20:00.762513 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f2a73617-40b7-4588-831c-c3a69b3c940b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:00.795764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f76215d-d21e-400b-bd75-eb374d39cee5 req-9ccec80c-bb39-488a-960b-31f1c9f09c18 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405526 Dec 14 03:20:00.838279 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f2a73617-40b7-4588-831c-c3a69b3c940b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:00.841980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f2a73617-40b7-4588-831c-c3a69b3c940b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:00.878097 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a73617-40b7-4588-831c-c3a69b3c940b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e157df06-39b4-4d53-b48c-b8da4779f7cf,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:00.883342 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f2a73617-40b7-4588-831c-c3a69b3c940b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=78b9592954fd41b993868a91d403a936&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2263756 Dec 14 03:20:00.886266 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54650) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:00.934609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:00.954400 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.000307 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.002841 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.004647 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e157df06-39b4-4d53-b48c-b8da4779f7cf HTTP/1.1" status: 204 len: 168 time: 0.1178052 Dec 14 03:20:01.012317 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bef3567-0435-4a16-91c5-d8ffbce5652e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e157df06-39b4-4d53-b48c-b8da4779f7cf,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:01.090638 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54656) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:01.136635 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Deleting subnet 5cfcc7bf-6dc9-4045-a09c-867974704f94 {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:20:01.140309 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.174981 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.184781 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.267107 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54660) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:01.281466 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ea087e79-6b07-44a4-b61b-9e089592120a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.362392 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ea087e79-6b07-44a4-b61b-9e089592120a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.366609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ea087e79-6b07-44a4-b61b-9e089592120a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.408225 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ea087e79-6b07-44a4-b61b-9e089592120a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c234c9524db34caeaa97556891588ae5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1397963 Dec 14 03:20:01.409222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea087e79-6b07-44a4-b61b-9e089592120a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2a1e6a7-ecf5-40da-b0ab-b40a0ca5b1f2,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:01.412531 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54662) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:01.452449 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.462202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.477416 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:20:01.478934 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5cfcc7bf-6dc9-4045-a09c-867974704f94,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:01.482652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.488405 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-9937f239-d90a-4be6-b209-eaf3aac6e9cb admin admin] 10.222.0.43 "DELETE /v2.0/subnets/5cfcc7bf-6dc9-4045-a09c-867974704f94 HTTP/1.1" status: 204 len: 168 time: 0.3939583 Dec 14 03:20:01.488663 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54664) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:01.489527 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.500879 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:20:01.501219 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:20:01.539352 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.542012 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.543188 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b2a1e6a7-ecf5-40da-b0ab-b40a0ca5b1f2 HTTP/1.1" status: 204 len: 168 time: 0.1297023 Dec 14 03:20:01.552337 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde9f71f-aa5a-49b4-b38b-af3ce3f7fa60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2a1e6a7-ecf5-40da-b0ab-b40a0ca5b1f2,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:01.559196 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.643352 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.666169 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.666719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.667547 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.667917 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > port after_create 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.668357 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > port after_delete 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.668763 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > port after_update 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.669022 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.669340 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.669793 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.670123 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.795628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.796234 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.796342 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.796642 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102571) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 14 03:20:01.797003 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['69a3889e-636a-4983-9398-edafd7db5301']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:20:01.813881 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36876166-6080-44fb-9026-20129e125f6e') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:20:01.814168 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36876166-6080-44fb-9026-20129e125f6e') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:20:01.830017 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.855738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.866299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Releasing vlan 282 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:20:01.866707 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: from cryptography.utils import int_from_bytes Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: from cryptography.utils import int_from_bytes Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:20:01.871237 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:20:01.957923 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.974433 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f161be3-5288-4fa0-aada-b77446e6d844 req-de82a898-4710-4527-b051-a75c6196966e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:01.976164 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f161be3-5288-4fa0-aada-b77446e6d844 req-de82a898-4710-4527-b051-a75c6196966e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0917923 Dec 14 03:20:01.988384 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:01.991594 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] 10.222.0.43 "DELETE /v2.0/networks/69a3889e-636a-4983-9398-edafd7db5301 HTTP/1.1" status: 204 len: 168 time: 0.5020072 Dec 14 03:20:01.992448 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc20aa0c-7776-4fa2-ad00-77ca289fb2ce admin admin] Pushing event deleted for resources: {'Network': ['ID=69a3889e-636a-4983-9398-edafd7db5301,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:02.041872 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5f161be3-5288-4fa0-aada-b77446e6d844 req-c137aada-4060-4e2c-9401-dc82e194ac09 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557225 Dec 14 03:20:02.128302 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54690) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:02.168758 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f48a5a9c-6a42-4a15-9904-b5a1844292e6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7ecea5c13a624ab8a3a445d3ede5fd77&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0391896 Dec 14 03:20:02.171185 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54694) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:02.218141 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.238885 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.285508 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.288368 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.289715 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a8c9bd0d-623a-43f5-95cb-d6df61f221ba HTTP/1.1" status: 204 len: 168 time: 0.1174276 Dec 14 03:20:02.297973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec1059c3-73b5-4f44-9a19-b90dc8cc00e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8c9bd0d-623a-43f5-95cb-d6df61f221ba,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:02.586110 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54710) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:02.692833 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a2c7a3f9-3b24-48f0-b9ae-59c47c0b8818 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.772986 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a2c7a3f9-3b24-48f0-b9ae-59c47c0b8818 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.777056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a2c7a3f9-3b24-48f0-b9ae-59c47c0b8818 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.814254 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a2c7a3f9-3b24-48f0-b9ae-59c47c0b8818 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a3bf5b304f66426f985a7a3a3963983f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2270253 Dec 14 03:20:02.815148 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c7a3f9-3b24-48f0-b9ae-59c47c0b8818 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e0a1a61-dfc0-45b4-a9ce-6a7c82edfe0b,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:02.817458 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54722) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:02.872544 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.898803 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.948890 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.951722 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:02.952883 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1e0a1a61-dfc0-45b4-a9ce-6a7c82edfe0b HTTP/1.1" status: 204 len: 168 time: 0.1343477 Dec 14 03:20:02.961678 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2217c2a-305b-4723-b9d9-c9136b2a2f94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e0a1a61-dfc0-45b4-a9ce-6a7c82edfe0b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:03.171835 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 req-6bbb0ee1-1046-4af8-ac86-bc0d95391c42 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:03.173354 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 req-6bbb0ee1-1046-4af8-ac86-bc0d95391c42 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0511510 Dec 14 03:20:03.226991 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 req-22096549-deae-450d-8d62-747e3e2a25bc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470002 Dec 14 03:20:03.662692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54766) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:03.759438 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1178514700-network', 'tenant_id': '325c78a0c8574ce0bb38f768705a1181'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:20:03.779711 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Made reservation on behalf of 325c78a0c8574ce0bb38f768705a1181 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:20:03.781940 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.790477 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.861103 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.864832 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.884230 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 275} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:20:03.897584 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dec61bef-9218-413c-b74e-76a85a176263,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:03.902157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.902498 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Added segment 291bfcba-705b-40e6-839b-25e1bec3a7fe of type vlan for network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 Dec 14 03:20:03.940598 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.963369 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:03.964277 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:03.964877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:04.019454 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3544707 Dec 14 03:20:04.022441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54770) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:04.026498 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ecb6f8-6e37-4294-9a1e-b67ea8ed95b8 admin admin] Pushing event updated for resources: {'Network': ['ID=72a1ba60-29fb-46d5-ae0c-f4c2277490a8,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:04.027476 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Request body: {'subnet': {'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1178514700-subnet', 'tenant_id': '325c78a0c8574ce0bb38f768705a1181', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:20:04.036846 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:20:04.047550 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Made reservation on behalf of 325c78a0c8574ce0bb38f768705a1181 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:20:04.049816 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12477423'] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:04.210335 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2037184', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12477425'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:04.267897 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:04.277009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Checking segment: {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:20:04.277369 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Network hostable DHCP agents. Network: 72a1ba60-29fb-46d5-ae0c-f4c2277490a8, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:20:04.295623 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:20:04.311538 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 72a1ba60-29fb-46d5-ae0c-f4c2277490a8) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:20:04.316192 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:04.317154 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:04.319775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04a4d22c-5f0e-40eb-b0ba-7c11eadca4cd None None] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:20:04.350153 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-631953a4-65bb-4868-998e-451253a840d4 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3265021 Dec 14 03:20:04.371722 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 req-78c8c6c7-c4c3-4023-8601-47484b54e726 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:04.372986 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 req-78c8c6c7-c4c3-4023-8601-47484b54e726 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0696831 Dec 14 03:20:04.421007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8afc46f8-7859-4864-86d5-f0ac39cee6a6 None None] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:20:04.424912 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 req-d1884662-8fe1-4c74-a911-a78eb5a6f0ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448871 Dec 14 03:20:05.509747 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:20:05.548133 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc req-95b42383-48eb-4b8b-8ebe-a52ba68c9241 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:05.549946 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc req-95b42383-48eb-4b8b-8ebe-a52ba68c9241 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 943 time: 0.0495741 Dec 14 03:20:05.598284 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc req-9f1c49cf-bc8f-4e06-a44b-a991c4e919d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417781 Dec 14 03:20:05.613964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:05.633240 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'mac_address': 'fa:16:3e:a7:2a:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:20:05.669606 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:05.682466 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:20:05.701246 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:05.704960 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:05.750231 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=9']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:05.757501 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.757875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.758236 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.758579 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.758910 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.759267 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.759597 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.759921 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.760243 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.760582 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.760906 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.761224 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:05.761542 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:20:06.082818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-5448c1d4-0fd2-485d-84be-d065ff45fd01 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:06.084386 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-5448c1d4-0fd2-485d-84be-d065ff45fd01 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 814 time: 0.1021285 Dec 14 03:20:06.098923 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-cfa49c89-5688-4124-84c6-27695fccbcf2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/quotas/325c78a0c8574ce0bb38f768705a1181 HTTP/1.1" status: 200 len: 375 time: 0.0090396 Dec 14 03:20:06.128388 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-b4568b56-b44c-447d-b8c8-0a14f0d1884e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0245395 Dec 14 03:20:06.262781 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-390e878e-c017-47d0-b739-97a75df96960 service neutron] 10.222.0.43 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278360 Dec 14 03:20:06.346617 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-afbd0531-0ba9-4013-8639-97464533a748 service neutron] 10.222.0.43 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0779052 Dec 14 03:20:06.503554 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9c2c379f-6cf4-4402-91a1-26c4a7e3b746 req-0f766b8f-3b17-45cb-b513-ede1951fc79a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 210 time: 0.0260143 Dec 14 03:20:06.726047 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d580004a-f18c-4478-b1f5-0dedb5e40613 req-a750a86b-a5ba-4406-b537-28537b5ea769 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:06.727549 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d580004a-f18c-4478-b1f5-0dedb5e40613 req-a750a86b-a5ba-4406-b537-28537b5ea769 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0547020 Dec 14 03:20:06.777823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d580004a-f18c-4478-b1f5-0dedb5e40613 req-19238dab-1513-42b3-bbda-8a41b1fec455 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442238 Dec 14 03:20:07.594832 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 req-47a301a0-82aa-4b0e-9266-af07b1472c53 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 210 time: 0.0250332 Dec 14 03:20:07.899259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d35be2-4517-4879-b04f-49d437c737d3 req-a6c52bd0-cb32-4ad5-80a2-107ca057b207 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:07.900713 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a4d35be2-4517-4879-b04f-49d437c737d3 req-a6c52bd0-cb32-4ad5-80a2-107ca057b207 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0487576 Dec 14 03:20:07.946136 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a4d35be2-4517-4879-b04f-49d437c737d3 req-fc58443a-b528-4e2a-9e9b-10926c8c6566 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396049 Dec 14 03:20:08.687210 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96c2e8a8-662b-461e-9987-a2c634d3b40b req-00dd7407-4059-4435-b0ff-7120cce7e4a7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 210 time: 0.0296111 Dec 14 03:20:09.064925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee5a448-eac6-4d5f-9dd9-495245cef216 req-c65657b3-bf62-486c-8812-bde355adefad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:09.066927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9ee5a448-eac6-4d5f-9dd9-495245cef216 req-c65657b3-bf62-486c-8812-bde355adefad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0480530 Dec 14 03:20:09.113310 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9ee5a448-eac6-4d5f-9dd9-495245cef216 req-b8a73640-2377-42d5-9cb9-cb678586a542 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402682 Dec 14 03:20:09.776773 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-57b9c469-06f5-4f0e-8945-e1413f8af9ea req-9ca0227a-6ec2-4a25-ae80-2312f27e7b71 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 210 time: 0.0253692 Dec 14 03:20:10.011979 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['85ceb16f-0c27-48e9-ab76-5cd49eb12802'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:20:10.239938 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e4f3d4-891e-4835-966e-3404f0e3b013 req-737d9378-6103-422d-a28b-af56a80b4b1e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:10.241830 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a0e4f3d4-891e-4835-966e-3404f0e3b013 req-737d9378-6103-422d-a28b-af56a80b4b1e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0569239 Dec 14 03:20:10.302330 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a0e4f3d4-891e-4835-966e-3404f0e3b013 req-1e4cc497-9aa6-47d1-9fe2-b8d6b48eafe1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540805 Dec 14 03:20:10.396007 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-1e2b0b5c-91e0-4284-b974-251f0729c2f1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:10.397679 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-1e2b0b5c-91e0-4284-b974-251f0729c2f1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 814 time: 0.1205266 Dec 14 03:20:10.418144 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Request body: {'port': {'device_id': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8', 'admin_state_up': True, 'tenant_id': '325c78a0c8574ce0bb38f768705a1181'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:20:10.527956 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Made reservation on behalf of 325c78a0c8574ce0bb38f768705a1181 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:20:10.531346 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:10.664595 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Allocated IP 172.20.0.5 (72a1ba60-29fb-46d5-ae0c-f4c2277490a8/9ff8b720-271a-4b6f-88c1-3bac5c3efbdc/dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:20:10.803688 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:10.836877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:10.884987 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:20:10.888148 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:20:10.888815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b84f541-44bb-49d6-a7ab-565f6fb72137 req-40eaa781-9cf3-43fd-8558-15ae99b93d7d tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:10.890300 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b84f541-44bb-49d6-a7ab-565f6fb72137 req-40eaa781-9cf3-43fd-8558-15ae99b93d7d tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 931 time: 0.0485394 Dec 14 03:20:10.891792 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:20:10.898153 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Pushing event updated for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:10.942454 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0b84f541-44bb-49d6-a7ab-565f6fb72137 req-026efa36-d6f0-4832-bda9-82e464ed9e6e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422385 Dec 14 03:20:10.943815 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:10.944442 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:10.960089 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-fa7b4834-a0ef-4754-ae78-e449194f8c95 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5455565 Dec 14 03:20:10.978396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Request body: {'port': {'device_id': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:20:11.029613 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.185986 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.278986 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:20:11.286858 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.298570 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Transition to ACTIVE for port object dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:20:11.301889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.366858 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Pushing event updated for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:11.422312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Attempting to bind port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:20:11.422927 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Attempting to bind port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:20:11.423061 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Attempting to bind port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:20:11.427334 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:20:11.427664 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Attempting to bind port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:20:11.432678 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 20, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:20:11.433009 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Checking segment: {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:20:11.433388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Bound using segment: {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:20:11.433637 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-337dafca-30e1-4855-b166-9a7db36ec8e9 req-ff780f2c-a5f8-419c-94c2-96c9f56b611e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:11.434411 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Bound port: dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:20:11.434763 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.435202 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-337dafca-30e1-4855-b166-9a7db36ec8e9 req-ff780f2c-a5f8-419c-94c2-96c9f56b611e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 944 time: 0.0516641 Dec 14 03:20:11.495979 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-337dafca-30e1-4855-b166-9a7db36ec8e9 req-cc91a3bc-ebde-4b02-b221-9e287dd2df65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518718 Dec 14 03:20:11.506212 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:20:11.510156 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:20:11.524938 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.566704 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:11.567515 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:11.568976 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-18405b34-dca8-4064-a453-8016fd243052 service neutron] 10.222.0.20 "PUT /v2.0/ports/dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb HTTP/1.1" status: 200 len: 1093 time: 0.5945380 Dec 14 03:20:11.569417 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:20:11.571773 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53a342c6-272d-4fc6-8c08-74c7d36edd01" -d '{"events": [{"name": "network-changed", "server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:20:11.598735 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18405b34-dca8-4064-a453-8016fd243052 service neutron] Pushing event updated for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:11.615765 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:20:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca x-openstack-request-id: req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:20:11.616144 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:20:11.616463 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:20:11.616870 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb', 'status': 'completed', 'code': 200} Dec 14 03:20:11.678853 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-aeeee1a5-22db-4d8b-862e-0481ba1c4779 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:11.680381 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-aeeee1a5-22db-4d8b-862e-0481ba1c4779 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 1096 time: 0.0411348 Dec 14 03:20:11.729890 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-9b5223c6-578a-42e7-8f89-af08ac8281af service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb HTTP/1.1" status: 200 len: 217 time: 0.0348737 Dec 14 03:20:11.787266 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-c3526a3f-17cc-43ea-af08-74ae3308619f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:11.788750 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-c3526a3f-17cc-43ea-af08-74ae3308619f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc HTTP/1.1" status: 200 len: 854 time: 0.0503550 Dec 14 03:20:11.821954 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-29927405-92cb-44ec-be69-da211eb9d813 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247073 Dec 14 03:20:11.908055 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-bc11eaae-fc51-453e-b64e-937893ca912b service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789075 Dec 14 03:20:12.001570 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e65dff24-fcdd-41c6-8187-062e709c2b5e req-6547dff3-78c1-4e6c-ba2a-2729cec221f9 service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855355 Dec 14 03:20:12.060040 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa33f464-6d67-4f39-875c-8d798b6aabdc req-194bd219-43e4-4501-923d-c06b961febfc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:12.061516 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa33f464-6d67-4f39-875c-8d798b6aabdc req-194bd219-43e4-4501-923d-c06b961febfc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 943 time: 0.0514233 Dec 14 03:20:12.095592 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:20:12.111141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aa33f464-6d67-4f39-875c-8d798b6aabdc req-6cf02fad-2978-40c8-a8be-eb33e397f1f9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427859 Dec 14 03:20:12.137534 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-6abb7cfd-391a-490f-9650-27fadcc21c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:12.139022 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-6abb7cfd-391a-490f-9650-27fadcc21c8a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 1096 time: 0.0421515 Dec 14 03:20:12.143097 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:20:12.143452 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:12.220434 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:12.230708 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-a93d51f8-beac-4fe9-a38a-15a3d74fb41c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:12.232201 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-a93d51f8-beac-4fe9-a38a-15a3d74fb41c service neutron] 10.222.0.20 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 915 time: 0.0844607 Dec 14 03:20:12.242872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:20:12.245127 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0d8b427-a124-4af2-a278-43a2ddc386f0" -d '{"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:20:12.258024 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:12.262512 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:12.274095 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-c6b5b282-348b-4a95-a5bc-3348a0d4bfe9 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb HTTP/1.1" status: 200 len: 217 time: 0.0350091 Dec 14 03:20:12.310866 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=10']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:12.322624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-7a6bb932-2324-48dd-87cc-54ea77296946 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:12.324147 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-7a6bb932-2324-48dd-87cc-54ea77296946 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc HTTP/1.1" status: 200 len: 854 time: 0.0427866 Dec 14 03:20:12.355516 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-14699993-7f72-4975-aa19-6d5bd9dffe11 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0240986 Dec 14 03:20:12.406518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:20:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30713918-d50d-4091-98a5-ef32bb9ac71a x-openstack-request-id: req-30713918-d50d-4091-98a5-ef32bb9ac71a {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:20:12.406818 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:20:12.407102 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-30713918-d50d-4091-98a5-ef32bb9ac71a {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:20:12.407503 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'code': 200} Dec 14 03:20:12.457269 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-20983d21-29e2-4954-aa2f-cea299c98a33 service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872004 Dec 14 03:20:12.557590 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-02baf99e-a0b9-4560-a8ef-73df4c7368cb service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913749 Dec 14 03:20:12.621681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 req-a367a330-80e8-47f7-a0b3-faaed169a15b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:12.623188 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 req-a367a330-80e8-47f7-a0b3-faaed169a15b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0519478 Dec 14 03:20:12.673065 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 req-75f09b27-db48-434b-8a8c-6336dfa29e66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440736 Dec 14 03:20:12.848861 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54926) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:12.955683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-598cb8f3-e09f-4dbc-bf4f-7c54cd5b86ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.031111 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-598cb8f3-e09f-4dbc-bf4f-7c54cd5b86ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.037365 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-598cb8f3-e09f-4dbc-bf4f-7c54cd5b86ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.076893 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-598cb8f3-e09f-4dbc-bf4f-7c54cd5b86ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cf77d49-bda1-40f6-a8d8-2933a4fb8a57,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:13.081234 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-598cb8f3-e09f-4dbc-bf4f-7c54cd5b86ce admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fcf932b53cde41bc84ba2b2f3e03aafa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2313166 Dec 14 03:20:13.084297 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54930) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:13.157553 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40cfccf-bc4b-4e97-81f0-f4d153289b76 req-e673e1d8-eecf-4f6d-9735-8ffde6da2f80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:13.159029 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e40cfccf-bc4b-4e97-81f0-f4d153289b76 req-e673e1d8-eecf-4f6d-9735-8ffde6da2f80 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1099 time: 0.0680137 Dec 14 03:20:13.174841 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.212264 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.224945 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c926d777-0428-491c-94a2-2bc5fd989c69 req-a0cf374a-b44d-4ea6-bedd-7759e98e0bf1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:13.226416 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c926d777-0428-491c-94a2-2bc5fd989c69 req-a0cf374a-b44d-4ea6-bedd-7759e98e0bf1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 943 time: 0.0475695 Dec 14 03:20:13.235929 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e40cfccf-bc4b-4e97-81f0-f4d153289b76 req-012a531c-68d3-4183-a230-ba74ffa2ebd5 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661073 Dec 14 03:20:13.267599 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.270384 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:13.271578 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1cf77d49-bda1-40f6-a8d8-2933a4fb8a57 HTTP/1.1" status: 204 len: 168 time: 0.1860454 Dec 14 03:20:13.273216 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c926d777-0428-491c-94a2-2bc5fd989c69 req-7f64631a-5f21-4f41-81c1-5b5e681e9482 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408058 Dec 14 03:20:13.281907 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c73dda-1bae-4296-a607-0dce829a8509 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cf77d49-bda1-40f6-a8d8-2933a4fb8a57,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:13.791924 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184b7858-dbd8-472f-8927-bf3530ff84f3 req-392add63-3e96-400a-996c-0ea6ea8cb651 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:13.793410 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-184b7858-dbd8-472f-8927-bf3530ff84f3 req-392add63-3e96-400a-996c-0ea6ea8cb651 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0483966 Dec 14 03:20:13.840499 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-184b7858-dbd8-472f-8927-bf3530ff84f3 req-5bc04959-00cc-4b01-b3af-1e2cc8566028 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408764 Dec 14 03:20:14.398433 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 req-4a93fa1c-1365-4211-9fcd-cd7429a5e6c8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:14.400084 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 req-4a93fa1c-1365-4211-9fcd-cd7429a5e6c8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 943 time: 0.0540605 Dec 14 03:20:14.407855 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 54986) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:14.446642 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 req-8d5b6d86-107d-463c-b543-05a27968b791 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405626 Dec 14 03:20:14.511428 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b158b3f-e181-4e55-af3a-709d259c9019 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.584456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b158b3f-e181-4e55-af3a-709d259c9019 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.587933 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b158b3f-e181-4e55-af3a-709d259c9019 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.627933 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5b158b3f-e181-4e55-af3a-709d259c9019 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d15cda26843f4a28842bed5262708115&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2187369 Dec 14 03:20:14.628796 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b158b3f-e181-4e55-af3a-709d259c9019 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc784c8f-0ba5-4d9e-9728-aa09de4b42a4,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:14.630713 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 54990) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:14.678094 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.698919 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.743737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.746269 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:14.747414 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cc784c8f-0ba5-4d9e-9728-aa09de4b42a4 HTTP/1.1" status: 204 len: 168 time: 0.1156790 Dec 14 03:20:14.755078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa0a054-6b92-4173-b82e-7196ba2ae8b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc784c8f-0ba5-4d9e-9728-aa09de4b42a4,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:14.969090 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c07cb-c816-4958-8eb2-9da05be7f53a req-ac561700-1313-4c9e-8d2c-d694a44e9ba3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:14.970965 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-641c07cb-c816-4958-8eb2-9da05be7f53a req-ac561700-1313-4c9e-8d2c-d694a44e9ba3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0572298 Dec 14 03:20:15.021266 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-641c07cb-c816-4958-8eb2-9da05be7f53a req-572d5ba2-bf8b-4918-9e00-b8ef4aebcf9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433626 Dec 14 03:20:15.563990 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aeeb4a2-1446-4486-bea2-70fce43795ff req-6af37178-b1c7-4045-8d98-1903da7a994e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:15.566189 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9aeeb4a2-1446-4486-bea2-70fce43795ff req-6af37178-b1c7-4045-8d98-1903da7a994e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 943 time: 0.0484900 Dec 14 03:20:15.623596 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9aeeb4a2-1446-4486-bea2-70fce43795ff req-f57a89ba-2a0d-41fc-b0dd-d214c3da274a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514579 Dec 14 03:20:16.108077 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:20:16.146554 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 req-8d6b684b-f96d-48e9-bfc8-9454ff84c616 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:16.148059 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 req-8d6b684b-f96d-48e9-bfc8-9454ff84c616 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0539265 Dec 14 03:20:16.200341 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 req-1f3b8f20-b7f1-4882-91c1-bde8272a75d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461934 Dec 14 03:20:16.202133 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:16.214331 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb', 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8', 'port_id': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb', 'mac_address': 'fa:16:3e:cd:a0:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 275, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ff8b720-271a-4b6f-88c1-3bac5c3efbdc', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:20:16.255339 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:16.268547 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:20:16.289537 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:16.292985 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:16.343940 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:16.737254 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b4f052-cc9c-4a27-bcbe-b207674845c9 req-53cf81bd-c621-4ce3-b3e8-77bf54670460 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:16.740019 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58b4f052-cc9c-4a27-bcbe-b207674845c9 req-53cf81bd-c621-4ce3-b3e8-77bf54670460 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 944 time: 0.0487428 Dec 14 03:20:16.741595 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:20:16.786763 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58b4f052-cc9c-4a27-bcbe-b207674845c9 req-b1837cc4-d53b-4137-914b-cc23eb3acb41 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403619 Dec 14 03:20:17.898647 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af36ae45-c271-4170-b87a-1726a9e4930b req-204fb748-5353-407d-804d-1a13b0f14ee3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:17.900063 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-af36ae45-c271-4170-b87a-1726a9e4930b req-204fb748-5353-407d-804d-1a13b0f14ee3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 944 time: 0.0469086 Dec 14 03:20:17.947816 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-af36ae45-c271-4170-b87a-1726a9e4930b req-9293f03b-95bc-4ef2-9856-3a90adf7436a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419812 Dec 14 03:20:18.116234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:20:18.163309 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:20:18.166858 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:20:18.167260 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:18.243004 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:18.264341 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:20:18.266527 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a605ae7c-4596-463e-9f4e-f8accaf6a18a" -d '{"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-plugged", "status": "completed", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:20:18.279502 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:20:18.283197 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:18.306014 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:20:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 x-openstack-request-id: req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:20:18.306330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-plugged", "status": "completed", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:20:18.306591 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:20:18.306980 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb', 'code': 200} Dec 14 03:20:18.331753 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:18.521036 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5491877-ca26-4de4-9cc7-265949f21f52 req-a7523d0e-aecf-4060-9fb5-ad947a6155a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:18.522470 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a5491877-ca26-4de4-9cc7-265949f21f52 req-a7523d0e-aecf-4060-9fb5-ad947a6155a8 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 1098 time: 0.0395052 Dec 14 03:20:18.567950 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a5491877-ca26-4de4-9cc7-265949f21f52 req-a72acbe5-8297-4bcf-a7a3-f5e751934dad service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361712 Dec 14 03:20:19.068017 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6ebe31-940f-440a-a3c1-c4f020101262 req-1c8f942d-3f1f-4610-854a-0401a160b16e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:19.069490 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c6ebe31-940f-440a-a3c1-c4f020101262 req-1c8f942d-3f1f-4610-854a-0401a160b16e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0538006 Dec 14 03:20:19.117512 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c6ebe31-940f-440a-a3c1-c4f020101262 req-308ac299-fb95-4f8d-82a5-75e547862e20 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420916 Dec 14 03:20:19.525798 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c req-c6b4fbb6-20d3-4fe5-9269-bfd1efd3fd09 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:19.527229 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c req-c6b4fbb6-20d3-4fe5-9269-bfd1efd3fd09 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0500169 Dec 14 03:20:19.577178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-f3e8e9d4-6a00-4b6b-a588-7c1df03a53da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:19.578664 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-f3e8e9d4-6a00-4b6b-a588-7c1df03a53da service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1138 time: 0.0389488 Dec 14 03:20:19.586694 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c req-71ad0ec4-0a24-4b83-a5b8-17f067be638d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0534060 Dec 14 03:20:19.669969 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1fdd7261-7e8c-4f87-8426-95e3404f0a41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:19.679645 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-54484902-872c-436e-ae3d-4a617068f420 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:19.681085 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-54484902-872c-436e-ae3d-4a617068f420 service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.0939586 Dec 14 03:20:20.231289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e152bd-c809-4c96-a82e-37d560d28f92 req-37f48fb5-5ada-44f4-8027-8a81682cb9ae tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:20.232698 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a5e152bd-c809-4c96-a82e-37d560d28f92 req-37f48fb5-5ada-44f4-8027-8a81682cb9ae tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0461595 Dec 14 03:20:20.288389 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a5e152bd-c809-4c96-a82e-37d560d28f92 req-8393f52e-f3e6-4625-a831-12be9899f756 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489912 Dec 14 03:20:20.679054 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-4081a625-652f-4491-a06a-7ec402885367 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 1002 time: 0.0592461 Dec 14 03:20:20.703907 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a8d3aa-e024-46c7-be04-d29cee9970f6 req-aa5c67b2-4979-485b-a164-1e772982ad3c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:20.705301 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91a8d3aa-e024-46c7-be04-d29cee9970f6 req-aa5c67b2-4979-485b-a164-1e772982ad3c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0502694 Dec 14 03:20:20.763333 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91a8d3aa-e024-46c7-be04-d29cee9970f6 req-4f4bf726-e5b1-42c4-bab6-8ccbef302dcb tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0521190 Dec 14 03:20:21.401315 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0469acfa-311e-49d4-9518-52ba86daca6f req-e945b764-dff0-4602-bcd3-100e1414ad22 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:21.402784 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0469acfa-311e-49d4-9518-52ba86daca6f req-e945b764-dff0-4602-bcd3-100e1414ad22 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0491703 Dec 14 03:20:21.448772 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0469acfa-311e-49d4-9518-52ba86daca6f req-bb306c60-bcfa-4017-912d-489590cd6ec2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401480 Dec 14 03:20:21.642329 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-a05fc213-8d96-4cbf-a650-776fb8731faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:21.644384 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-a05fc213-8d96-4cbf-a650-776fb8731faf service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0467627 Dec 14 03:20:21.862961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e5fa5c25-521a-4ead-a82b-7502984da2bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:21.879304 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5040412-1cad-4bce-8476-e680dd4961df req-34b720e6-f1a6-4ac2-858c-51ebba776e0e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:21.880745 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5040412-1cad-4bce-8476-e680dd4961df req-34b720e6-f1a6-4ac2-858c-51ebba776e0e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0531633 Dec 14 03:20:21.938826 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5040412-1cad-4bce-8476-e680dd4961df req-f837de43-e718-46e0-849a-00afb8f43f62 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0519865 Dec 14 03:20:22.564681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 req-0f3df9c9-4db6-4a73-a717-769fb38c42dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:22.566104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 req-0f3df9c9-4db6-4a73-a717-769fb38c42dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0466392 Dec 14 03:20:22.610654 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 req-5eebc036-8203-4eec-a662-c4e6ab24aa65 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387125 Dec 14 03:20:22.945949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-6fe29be1-fafd-477d-8bac-3fcad89eeb22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:22.947425 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-6fe29be1-fafd-477d-8bac-3fcad89eeb22 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399003 Dec 14 03:20:23.035339 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-f557af2b-4bc3-4869-9140-d198e0bd2c65 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798018 Dec 14 03:20:23.055117 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0975f0-f617-45cf-937a-b22ce381048c req-ce9fc509-29b1-4e53-8771-db27d94ca342 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:23.056680 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d0975f0-f617-45cf-937a-b22ce381048c req-ce9fc509-29b1-4e53-8771-db27d94ca342 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0521967 Dec 14 03:20:23.116591 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d0975f0-f617-45cf-937a-b22ce381048c req-36808e5b-ad6f-4251-88bb-ca599045d5a3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0536788 Dec 14 03:20:23.128525 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-619dd284-d386-43b5-92db-d9b3af9415a5 req-20a1ac7f-bbab-4112-86b6-461bf888bbe3 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847869 Dec 14 03:20:23.581487 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:23.736698 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-024810b2-f24d-4ce5-9bc4-cea42cdff36f req-df9c9802-8aba-42c4-8d88-8378308035f3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:23.739121 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-024810b2-f24d-4ce5-9bc4-cea42cdff36f req-df9c9802-8aba-42c4-8d88-8378308035f3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0494628 Dec 14 03:20:23.785899 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-024810b2-f24d-4ce5-9bc4-cea42cdff36f req-fc3c871b-5d93-44a1-b48f-45569f085a54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406613 Dec 14 03:20:24.226277 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00094744-b40b-469e-bebe-8209340395e0 req-c05d68fd-20ac-4e52-b599-e8ee9f9da646 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:24.227710 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00094744-b40b-469e-bebe-8209340395e0 req-c05d68fd-20ac-4e52-b599-e8ee9f9da646 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0461564 Dec 14 03:20:24.287851 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00094744-b40b-469e-bebe-8209340395e0 req-2103bf9c-c8a4-4bc2-8cb2-e5421c9fb9cc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0542924 Dec 14 03:20:24.573107 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:24.905755 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f2eb67-1d30-46d6-b283-21da91ae924a req-8fe8617a-f83d-4572-a735-3f1d05a57c89 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:24.907237 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d1f2eb67-1d30-46d6-b283-21da91ae924a req-8fe8617a-f83d-4572-a735-3f1d05a57c89 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0526650 Dec 14 03:20:24.953487 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d1f2eb67-1d30-46d6-b283-21da91ae924a req-7202cb20-d866-46fc-a8a0-b90c0862ca40 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398755 Dec 14 03:20:25.413244 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e86e10-e575-424e-aea3-fc25a1e81084 req-c139862c-d839-4da7-a852-aa16540c7c2a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:25.414735 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69e86e10-e575-424e-aea3-fc25a1e81084 req-c139862c-d839-4da7-a852-aa16540c7c2a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0532734 Dec 14 03:20:25.474030 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69e86e10-e575-424e-aea3-fc25a1e81084 req-14437f7e-b35a-4d92-81fd-3df13f2c9814 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0527697 Dec 14 03:20:25.795637 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:26.592476 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e req-403d3f59-b6ed-4f6e-8117-079b0e4258ea tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:26.593957 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e req-403d3f59-b6ed-4f6e-8117-079b0e4258ea tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0538039 Dec 14 03:20:26.653646 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e req-c3fa8918-d8a8-44be-8664-51979a3110de tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0530276 Dec 14 03:20:27.564087 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55276) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:27.667820 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f09cc3e5-9ab9-4ad2-ac67-bdff4682efc4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.769642 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f09cc3e5-9ab9-4ad2-ac67-bdff4682efc4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.776760 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f09cc3e5-9ab9-4ad2-ac67-bdff4682efc4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.806303 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6bf212f-4cf4-4b08-aef6-1e11832b185f req-f63b0ea5-0580-4aea-a94c-00c8db6ddf5a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:27.807907 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6bf212f-4cf4-4b08-aef6-1e11832b185f req-f63b0ea5-0580-4aea-a94c-00c8db6ddf5a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0845418 Dec 14 03:20:27.846994 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f09cc3e5-9ab9-4ad2-ac67-bdff4682efc4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b24f5590f7f94bdca6848a5e109242f9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2818077 Dec 14 03:20:27.849498 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f09cc3e5-9ab9-4ad2-ac67-bdff4682efc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b935853b-07b2-4522-ac25-75dd800eb872,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:27.850135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55282) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:27.893197 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f6bf212f-4cf4-4b08-aef6-1e11832b185f req-6638c0fa-dde8-452c-a56b-d567a7683925 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0755296 Dec 14 03:20:27.899659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.921301 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.967127 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.969557 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:27.970688 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b935853b-07b2-4522-ac25-75dd800eb872 HTTP/1.1" status: 204 len: 168 time: 0.1195769 Dec 14 03:20:27.978496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4810d4-5789-450c-a67c-9cef1b51c3b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b935853b-07b2-4522-ac25-75dd800eb872,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:28.226298 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55288) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:28.239898 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-22cefa1c-b942-4131-bc4e-414014ab1850 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.312357 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-22cefa1c-b942-4131-bc4e-414014ab1850 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.315923 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-22cefa1c-b942-4131-bc4e-414014ab1850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.357789 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-22cefa1c-b942-4131-bc4e-414014ab1850 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ff0c51a9efd1409793b0e21a4094ee8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1302083 Dec 14 03:20:28.359330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22cefa1c-b942-4131-bc4e-414014ab1850 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dad01d97-7cf0-4c5b-ab02-3195ba0ee9e8,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:28.360615 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55290) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:28.409399 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.432116 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.479858 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.482495 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:28.483764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/dad01d97-7cf0-4c5b-ab02-3195ba0ee9e8 HTTP/1.1" status: 204 len: 168 time: 0.1221032 Dec 14 03:20:28.493444 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf1869c-704e-4af5-9494-3b16024241b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dad01d97-7cf0-4c5b-ab02-3195ba0ee9e8,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:29.010059 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491ff9da-6ff7-44b4-8174-038af9d21aee req-09cd47b9-b1ad-4059-8b0a-3b83d3974ea8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:29.011569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-491ff9da-6ff7-44b4-8174-038af9d21aee req-09cd47b9-b1ad-4059-8b0a-3b83d3974ea8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0508792 Dec 14 03:20:29.074502 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-491ff9da-6ff7-44b4-8174-038af9d21aee req-1a7ed5ba-6395-48e2-9113-176ad487e3ba tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0568354 Dec 14 03:20:30.194338 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a177aa07-5e60-4bb3-b7ab-af04200f3778 req-e469110f-e4d1-44d5-af30-53d8b980b73e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:30.195828 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a177aa07-5e60-4bb3-b7ab-af04200f3778 req-e469110f-e4d1-44d5-af30-53d8b980b73e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0529003 Dec 14 03:20:30.262776 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a177aa07-5e60-4bb3-b7ab-af04200f3778 req-c22429eb-c737-43a5-81e7-d2f20cfc620f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0605266 Dec 14 03:20:31.375815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1514e30f-a110-45e5-b372-ae7b9dc38873 req-34ba0615-5ce0-4e96-be55-3d0d74e790cc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:31.377313 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1514e30f-a110-45e5-b372-ae7b9dc38873 req-34ba0615-5ce0-4e96-be55-3d0d74e790cc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0473320 Dec 14 03:20:31.437661 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1514e30f-a110-45e5-b372-ae7b9dc38873 req-ecf51822-2ffa-4928-8b6a-4efc753adbb4 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0536230 Dec 14 03:20:32.557366 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660b457d-5f7c-43a1-82b7-7a2c88da540a req-98aba050-2924-4077-9d33-b288535b91a0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:32.558840 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-660b457d-5f7c-43a1-82b7-7a2c88da540a req-98aba050-2924-4077-9d33-b288535b91a0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0533707 Dec 14 03:20:32.622161 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-660b457d-5f7c-43a1-82b7-7a2c88da540a req-b7cf6c95-1cbb-478e-bdc7-8a4875ca22ae tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0573382 Dec 14 03:20:32.998134 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:20:33.739056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 req-360c0907-c4ab-4dd2-9c30-60db4396b81f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:33.742273 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 req-360c0907-c4ab-4dd2-9c30-60db4396b81f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0502255 Dec 14 03:20:33.799649 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 req-4a7375e7-516a-42cc-acc4-e4dcd1e95f74 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0525689 Dec 14 03:20:34.921293 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845a9d63-6f38-4055-8071-c75e81031c96 req-557fba3b-9bcf-426d-ac3e-009fbddeac40 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:34.922796 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-845a9d63-6f38-4055-8071-c75e81031c96 req-557fba3b-9bcf-426d-ac3e-009fbddeac40 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0515974 Dec 14 03:20:34.993009 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-845a9d63-6f38-4055-8071-c75e81031c96 req-6472ca5a-2744-4f42-9cd6-12b8aa195fd7 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0630584 Dec 14 03:20:36.106591 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e738d150-2665-4e21-a1bf-edfc2f1d050d req-c31f6187-32e5-4f5e-a4a9-aebe80569205 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:36.108147 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e738d150-2665-4e21-a1bf-edfc2f1d050d req-c31f6187-32e5-4f5e-a4a9-aebe80569205 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0485349 Dec 14 03:20:36.167068 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e738d150-2665-4e21-a1bf-edfc2f1d050d req-f2142cd7-ef9c-4afc-bcc8-3e82ad0c213e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0525837 Dec 14 03:20:37.003808 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55454) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:37.109456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6dea1436-4973-437d-805b-98224b9b366b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.181426 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6dea1436-4973-437d-805b-98224b9b366b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.184854 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6dea1436-4973-437d-805b-98224b9b366b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.223272 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dea1436-4973-437d-805b-98224b9b366b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=450d67d0-ad74-4589-9412-5a74d6975659,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:37.229981 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6dea1436-4973-437d-805b-98224b9b366b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=baef1db6fd0748f6b4f7fc08a9c1769d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2227347 Dec 14 03:20:37.230315 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55462) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:37.316081 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0718daca-51ef-418c-a852-90800cbdaf55 req-e8cce9f7-ccc3-4d30-850e-fc8527b90cba tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:37.317527 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0718daca-51ef-418c-a852-90800cbdaf55 req-e8cce9f7-ccc3-4d30-850e-fc8527b90cba tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0802372 Dec 14 03:20:37.320908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.354150 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.416229 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0718daca-51ef-418c-a852-90800cbdaf55 req-5abe9c02-af70-46b8-a1c3-7ef6e9214bf3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0909433 Dec 14 03:20:37.433311 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.435913 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.437432 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/450d67d0-ad74-4589-9412-5a74d6975659 HTTP/1.1" status: 204 len: 168 time: 0.2059066 Dec 14 03:20:37.447582 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c995430-884d-4380-b09e-ee1916dcc174 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=450d67d0-ad74-4589-9412-5a74d6975659,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:37.704845 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55470) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:37.718811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1a4ce21c-e30b-4526-b8f9-2993278231c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.793962 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1a4ce21c-e30b-4526-b8f9-2993278231c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.800472 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1a4ce21c-e30b-4526-b8f9-2993278231c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.838424 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4ce21c-e30b-4526-b8f9-2993278231c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d028a5af-6316-48f7-8ce8-9543f1e31dd5,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:37.843136 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-1a4ce21c-e30b-4526-b8f9-2993278231c7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b759260069d74f6dbcca9a61d0979500&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1372058 Dec 14 03:20:37.845966 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55472) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:37.900801 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.925732 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.981489 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.984169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:37.985330 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d028a5af-6316-48f7-8ce8-9543f1e31dd5 HTTP/1.1" status: 204 len: 168 time: 0.1384604 Dec 14 03:20:37.994429 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80640360-675b-4cb1-a578-8eec9affeec8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d028a5af-6316-48f7-8ce8-9543f1e31dd5,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:38.324100 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55480) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:38.337931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-300e71fb-4b73-416b-920e-b011d39ae8f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.420238 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-300e71fb-4b73-416b-920e-b011d39ae8f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.424967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-300e71fb-4b73-416b-920e-b011d39ae8f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.461376 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-300e71fb-4b73-416b-920e-b011d39ae8f6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1d1fe3aef6354bb9a24f3981c09ce114&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1362145 Dec 14 03:20:38.463249 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300e71fb-4b73-416b-920e-b011d39ae8f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81fbb7db-88b3-41a8-9fb6-22a294c09249,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:38.464139 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55484) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:38.518104 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.538819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.540477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 req-d43a6fef-8148-4e05-913c-dcafca4c1384 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:38.541982 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 req-d43a6fef-8148-4e05-913c-dcafca4c1384 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0470917 Dec 14 03:20:38.587170 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.589739 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:38.590853 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/81fbb7db-88b3-41a8-9fb6-22a294c09249 HTTP/1.1" status: 204 len: 168 time: 0.1257393 Dec 14 03:20:38.598251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eb264d4-3c34-4296-bec8-3053bf66ab61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81fbb7db-88b3-41a8-9fb6-22a294c09249,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:38.606761 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 req-c43e8567-4cde-4ea0-9ebf-cd3488298000 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0583282 Dec 14 03:20:39.744242 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 req-4e2f7f14-7291-4d5b-994e-76d680eec466 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:39.745788 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 req-4e2f7f14-7291-4d5b-994e-76d680eec466 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0501997 Dec 14 03:20:39.816320 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 req-a3d6e3cb-a80f-4c96-a356-fe2eee9de385 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0645394 Dec 14 03:20:40.936769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792e8f25-079d-4d71-9163-cf18086229be req-907af090-483e-461c-93d2-a6032a1e41f1 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:40.938193 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-792e8f25-079d-4d71-9163-cf18086229be req-907af090-483e-461c-93d2-a6032a1e41f1 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0490453 Dec 14 03:20:40.996671 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-792e8f25-079d-4d71-9163-cf18086229be req-057628fd-d366-4a1d-b154-99307ff5f22a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&id=fa44b3d3-acb1-44ee-af7e-bffca3aa686e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0524836 Dec 14 03:20:41.204974 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:41.581876 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 req-951c7c96-a8b8-4a69-b0d9-d099334fcb91 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:41.583456 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 req-951c7c96-a8b8-4a69-b0d9-d099334fcb91 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0478585 Dec 14 03:20:41.629907 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 req-317fd336-cab1-4daf-b8ae-0bb9e81cf162 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405929 Dec 14 03:20:42.759413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aadd82f7-1a83-452d-ac54-c6f16bc13639 req-85acdc93-facc-4533-a91e-65e3f490b165 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:42.760897 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aadd82f7-1a83-452d-ac54-c6f16bc13639 req-85acdc93-facc-4533-a91e-65e3f490b165 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0529027 Dec 14 03:20:42.810147 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aadd82f7-1a83-452d-ac54-c6f16bc13639 req-be5d6b7b-110a-44e3-b0c6-cad25c8ece08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434346 Dec 14 03:20:43.923584 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a260ba-276e-427e-b9c3-460daf2eea49 req-c334fea1-e716-4a60-badd-e55b91474152 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:43.925050 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71a260ba-276e-427e-b9c3-460daf2eea49 req-c334fea1-e716-4a60-badd-e55b91474152 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0489874 Dec 14 03:20:43.970995 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71a260ba-276e-427e-b9c3-460daf2eea49 req-bf13d95b-c1ae-47ba-9df4-eebb052afd17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394211 Dec 14 03:20:44.376508 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-4f28049d-4d31-4341-b62a-ac3428d09114 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384984 Dec 14 03:20:44.496624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-c0ed0b03-9fee-4c9b-88d8-97657f3c97d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:44.498058 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-c0ed0b03-9fee-4c9b-88d8-97657f3c97d2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 1099 time: 0.0396116 Dec 14 03:20:44.604260 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-fb6cd29e-a108-4978-b549-69be576d4b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:44.605796 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-fb6cd29e-a108-4978-b549-69be576d4b1d service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0832624 Dec 14 03:20:44.673247 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-620536cc-cadc-4e57-950f-551c33260b1a service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 200 len: 1000 time: 0.0583394 Dec 14 03:20:44.727998 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-5b7ffa8d-a8cc-474b-9b4f-603dba0dd4be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:44.729463 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-5b7ffa8d-a8cc-474b-9b4f-603dba0dd4be service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0461030 Dec 14 03:20:44.777096 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-9047e660-5e81-4026-971a-d1e86b9a510d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:44.778569 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-9047e660-5e81-4026-971a-d1e86b9a510d service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0389810 Dec 14 03:20:44.881120 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-69a0d79f-210b-4807-a22d-fe2b0e7b7f7f service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869427 Dec 14 03:20:44.984076 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a45fc33b-f89b-4928-bf61-13a9ecf70e84 req-353db09b-ca18-46de-b88e-36ef7b28ad44 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851519 Dec 14 03:20:45.085569 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a533be-402f-4226-90d8-9096a61bedd8 req-b9b30f11-1919-4a96-a5ba-f4e691a31687 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:45.086998 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-45a533be-402f-4226-90d8-9096a61bedd8 req-b9b30f11-1919-4a96-a5ba-f4e691a31687 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0498161 Dec 14 03:20:45.137805 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-45a533be-402f-4226-90d8-9096a61bedd8 req-d679dfba-6474-4f7b-aa02-d6ff903bca38 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448155 Dec 14 03:20:46.248987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9f86e3-a285-494b-84cc-5c95acff64f8 req-0cfd0be3-e51f-4807-acc6-be953c820268 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:46.250405 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bf9f86e3-a285-494b-84cc-5c95acff64f8 req-0cfd0be3-e51f-4807-acc6-be953c820268 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0470452 Dec 14 03:20:46.296002 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bf9f86e3-a285-494b-84cc-5c95acff64f8 req-d71228ba-fe3b-4b36-8d2b-631eb9ae9726 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397947 Dec 14 03:20:47.408817 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 req-ca22d0e6-063f-4167-a1e2-c51d7ac5e6ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:47.410292 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 req-ca22d0e6-063f-4167-a1e2-c51d7ac5e6ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0487638 Dec 14 03:20:47.456358 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 req-9eeee98b-a16a-45ff-ae1e-cf3eaee193fe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400329 Dec 14 03:20:48.574979 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 req-db495d77-bbea-44d7-a4e4-a797f56049e6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:48.575918 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55678) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:48.576733 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 req-db495d77-bbea-44d7-a4e4-a797f56049e6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0526266 Dec 14 03:20:48.623579 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 req-7d313d79-4a53-414c-8ace-d6c9e7f15123 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409477 Dec 14 03:20:48.680354 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-799b6a48-cef0-48c9-aaa5-1daba060f3b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.752769 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-799b6a48-cef0-48c9-aaa5-1daba060f3b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.757089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-799b6a48-cef0-48c9-aaa5-1daba060f3b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.793688 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-799b6a48-cef0-48c9-aaa5-1daba060f3b8 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5145ff6dce6e43068f06bc80e96bfab2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2167666 Dec 14 03:20:48.794800 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799b6a48-cef0-48c9-aaa5-1daba060f3b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=197006df-7caa-4574-b0e4-2c432a8e0211,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:48.796389 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55682) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:48.843742 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.864620 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.909033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.911657 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:48.913298 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/197006df-7caa-4574-b0e4-2c432a8e0211 HTTP/1.1" status: 204 len: 168 time: 0.1151583 Dec 14 03:20:48.921004 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ef5373-37fb-4b32-a983-159977af8e03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=197006df-7caa-4574-b0e4-2c432a8e0211,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:49.165041 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55688) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:49.177719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4416e706-359b-4644-8ede-6459cc102d2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.253148 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4416e706-359b-4644-8ede-6459cc102d2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.256885 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4416e706-359b-4644-8ede-6459cc102d2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.294685 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-4416e706-359b-4644-8ede-6459cc102d2e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c304d1c1cffc4cd2b2b7ca9c7481f946&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1285806 Dec 14 03:20:49.295649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4416e706-359b-4644-8ede-6459cc102d2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cf69821-7f96-4db6-902e-2b22bd1e940a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:49.297419 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55690) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:49.343742 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.364223 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.411302 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.414543 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.415679 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5cf69821-7f96-4db6-902e-2b22bd1e940a HTTP/1.1" status: 204 len: 168 time: 0.1172974 Dec 14 03:20:49.423389 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139ff51b-9678-4048-9522-790516bd0f89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cf69821-7f96-4db6-902e-2b22bd1e940a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:49.679242 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-41867c29-0933-431a-bd42-570cc203d80e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.735848 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 55700) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:49.753536 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-65c19c14-280c-46c5-8a9f-fa2af7c85ecb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.753745 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5030e31-a212-438b-9a8b-2f72f77f92ca req-581f13c3-0955-43fe-a076-51b29d48056f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:49.755139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5030e31-a212-438b-9a8b-2f72f77f92ca req-581f13c3-0955-43fe-a076-51b29d48056f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0492687 Dec 14 03:20:49.803490 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5030e31-a212-438b-9a8b-2f72f77f92ca req-a6071caf-4a43-4e2b-940e-eac5ebf06f81 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418973 Dec 14 03:20:49.828251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-65c19c14-280c-46c5-8a9f-fa2af7c85ecb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.831971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-65c19c14-280c-46c5-8a9f-fa2af7c85ecb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.869763 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-65c19c14-280c-46c5-8a9f-fa2af7c85ecb admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=09bee1a1729b474990858b78e2e5240b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1328814 Dec 14 03:20:49.870596 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c19c14-280c-46c5-8a9f-fa2af7c85ecb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89fa096e-1803-4184-b469-ed14b0a8c5b0,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:49.872401 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 55702) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:20:49.919244 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.939902 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.986417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.989473 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:49.990572 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/89fa096e-1803-4184-b469-ed14b0a8c5b0 HTTP/1.1" status: 204 len: 168 time: 0.1170118 Dec 14 03:20:49.998202 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e98b35c-1e8f-4fe9-867f-84d0099cd086 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89fa096e-1803-4184-b469-ed14b0a8c5b0,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:20:50.917255 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25833ba8-578d-4395-8ccb-2ca43e4f62fb req-bd80398d-bdd6-4179-b8a1-c9ed5adb2fa3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:50.918708 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25833ba8-578d-4395-8ccb-2ca43e4f62fb req-bd80398d-bdd6-4179-b8a1-c9ed5adb2fa3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0476098 Dec 14 03:20:50.965657 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25833ba8-578d-4395-8ccb-2ca43e4f62fb req-256b02da-3cb5-4cbf-869a-d7e3110093f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410833 Dec 14 03:20:51.865961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1c166356-6805-49aa-9bc6-73da021c73f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:52.078679 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beab278f-5f9f-41a0-a404-78ef1047f235 req-97cc83bc-2310-4880-97b8-1d7dd66a98f1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:52.080116 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-beab278f-5f9f-41a0-a404-78ef1047f235 req-97cc83bc-2310-4880-97b8-1d7dd66a98f1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0468993 Dec 14 03:20:52.125532 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-beab278f-5f9f-41a0-a404-78ef1047f235 req-2e2b864d-c75f-4803-81b6-9c4956ceadc4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394473 Dec 14 03:20:53.237262 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1059e87-c0ea-4c72-9806-43c6707a1119 req-95b6e63f-6b85-458c-b8b1-25f83c0ccb03 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:53.238965 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1059e87-c0ea-4c72-9806-43c6707a1119 req-95b6e63f-6b85-458c-b8b1-25f83c0ccb03 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0499475 Dec 14 03:20:53.284426 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f1059e87-c0ea-4c72-9806-43c6707a1119 req-22ca0f4b-f59c-442a-97de-fee49fcec03c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391915 Dec 14 03:20:53.583488 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:54.396980 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce req-5888a5d2-1fa0-4fac-90d4-e35bca2f4a96 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:54.398931 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce req-5888a5d2-1fa0-4fac-90d4-e35bca2f4a96 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0474057 Dec 14 03:20:54.445326 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce req-babeef4f-2394-4b42-9d8e-aa596124b734 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404618 Dec 14 03:20:54.575717 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:55.557422 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 req-ee36d65d-dbe4-478d-bbd0-53e43f117415 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:55.558831 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 req-ee36d65d-dbe4-478d-bbd0-53e43f117415 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0462625 Dec 14 03:20:55.607127 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 req-060f5d91-d532-4ff5-b81c-a07d6c159c69 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422761 Dec 14 03:20:55.797472 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:20:56.720578 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff req-8a476855-d18a-4a82-874a-9c8676f08485 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:56.722082 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff req-8a476855-d18a-4a82-874a-9c8676f08485 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0480106 Dec 14 03:20:56.766970 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff req-178579a9-b8de-45fa-b251-6287a54a2fe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384831 Dec 14 03:20:57.879465 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b94bf2fd-f4a7-472d-ab08-4896478f0565 req-e7020db4-14b2-405b-b00b-2bdc09425d9c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:57.880907 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b94bf2fd-f4a7-472d-ab08-4896478f0565 req-e7020db4-14b2-405b-b00b-2bdc09425d9c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0484343 Dec 14 03:20:57.926545 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b94bf2fd-f4a7-472d-ab08-4896478f0565 req-c27e9218-c8d7-4323-bc6e-d6fb3f3d3a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392160 Dec 14 03:20:59.051500 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 req-96f4d7f2-c0af-40ab-9d73-07546e0e6323 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:20:59.052977 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 req-96f4d7f2-c0af-40ab-9d73-07546e0e6323 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0624151 Dec 14 03:20:59.099174 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 req-ebeec240-44da-443e-bbe8-7fadc356466f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398505 Dec 14 03:21:00.212382 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b req-1db60e74-e273-4a75-ae9c-79f526271521 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:00.214225 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b req-1db60e74-e273-4a75-ae9c-79f526271521 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0489089 Dec 14 03:21:00.266314 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b req-4891365e-6711-4439-b9ea-91f3a2262eb8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464590 Dec 14 03:21:01.380709 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd00dd71-840e-4e13-822f-847b5e44af19 req-8c1f8119-aa83-4e47-8910-7000dd973324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:01.382769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bd00dd71-840e-4e13-822f-847b5e44af19 req-8c1f8119-aa83-4e47-8910-7000dd973324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0510554 Dec 14 03:21:01.428988 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bd00dd71-840e-4e13-822f-847b5e44af19 req-543e7954-f86d-4cd9-bf14-d5035499dcf1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398185 Dec 14 03:21:02.542672 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 req-ff09d11b-8ad8-40d1-9114-1d7d15dc238c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:02.544184 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 req-ff09d11b-8ad8-40d1-9114-1d7d15dc238c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0477426 Dec 14 03:21:02.590316 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 req-2e241347-bfd5-4891-af78-74dbb1cbc189 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402389 Dec 14 03:21:02.817789 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ee8471-ab43-4e5c-b136-376ad00c863a req-0c641368-997c-4edd-a54a-89da95ba0baf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:02.819896 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5ee8471-ab43-4e5c-b136-376ad00c863a req-0c641368-997c-4edd-a54a-89da95ba0baf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0466306 Dec 14 03:21:02.868155 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5ee8471-ab43-4e5c-b136-376ad00c863a req-62746efd-ed1e-4942-9372-1d9962f44487 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424435 Dec 14 03:21:03.983905 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f req-68f31bf1-f64c-4f09-8ff0-a46fd54d4c7d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:03.985318 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f req-68f31bf1-f64c-4f09-8ff0-a46fd54d4c7d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0469465 Dec 14 03:21:04.030758 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f req-42a2ddf7-f2fa-4cbc-ac0a-411701aba3b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394180 Dec 14 03:21:05.141068 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb req-e11b1d26-c73a-4373-beb4-aae993eba66f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:05.142501 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb req-e11b1d26-c73a-4373-beb4-aae993eba66f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0469432 Dec 14 03:21:05.187715 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb req-e13b69ec-7830-4815-95f0-506db3465e03 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389378 Dec 14 03:21:05.741863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abc6785-d023-425e-9af1-7c616f30189b req-a2da7683-a577-4faf-9032-c8581f529482 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:05.743320 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-a2da7683-a577-4faf-9032-c8581f529482 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.0389295 Dec 14 03:21:05.833439 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abc6785-d023-425e-9af1-7c616f30189b req-8a9b562c-730a-46fd-a680-2782f1c6e65e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:05.834910 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-8a9b562c-730a-46fd-a680-2782f1c6e65e service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.0846896 Dec 14 03:21:05.897482 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-6aba49f1-5ddb-42c7-8e45-4235e796b5e7 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 1001 time: 0.0550797 Dec 14 03:21:05.948762 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abc6785-d023-425e-9af1-7c616f30189b req-0134197a-5f7e-4853-a273-719d7f79db6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:05.950111 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-0134197a-5f7e-4853-a273-719d7f79db6f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0441439 Dec 14 03:21:05.993396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abc6785-d023-425e-9af1-7c616f30189b req-2d24e62f-809a-4fc7-82ed-5d7b75834b3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:05.994768 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-2d24e62f-809a-4fc7-82ed-5d7b75834b3c service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0371339 Dec 14 03:21:06.080088 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-b25b348e-f4a2-4959-900a-cff521a985c9 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0780103 Dec 14 03:21:06.170861 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2abc6785-d023-425e-9af1-7c616f30189b req-70646729-e3ea-4c55-adeb-7b38fe7f01b8 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828037 Dec 14 03:21:06.303031 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd req-e609a9ad-81e0-41e7-a807-e4bbbb28c5a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:06.305019 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd req-e609a9ad-81e0-41e7-a807-e4bbbb28c5a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0502894 Dec 14 03:21:06.350488 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd req-b8ed5aa8-790c-445b-bb6f-1b564738f30e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396922 Dec 14 03:21:07.462667 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1656845e-c71b-47a8-a1c4-6445cc162a18 req-d533f2d7-d77b-48d0-aa96-85494f57d60b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:07.464101 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1656845e-c71b-47a8-a1c4-6445cc162a18 req-d533f2d7-d77b-48d0-aa96-85494f57d60b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0467341 Dec 14 03:21:07.509171 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1656845e-c71b-47a8-a1c4-6445cc162a18 req-c4665f44-7e6a-4590-93f0-6106587f0d71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392523 Dec 14 03:21:09.997459 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:21:11.223997 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:19.671646 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b3951627-2bb1-4b01-b77a-582d521e15fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:21.869067 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-38faa833-887a-4070-8314-bb7b40965185 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:21.956825 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 req-45d434b9-6873-4a6c-a0ab-ca31f0978f87 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:21.958177 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 req-45d434b9-6873-4a6c-a0ab-ca31f0978f87 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0472567 Dec 14 03:21:22.009780 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 req-5fe7edee-0d8d-45c0-9a63-cfb2ce53466a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457170 Dec 14 03:21:23.123063 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fda9364-91bb-426f-b34f-67588888b28b req-37c5da72-c055-4659-a111-bbbbfffde74f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:23.124489 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1fda9364-91bb-426f-b34f-67588888b28b req-37c5da72-c055-4659-a111-bbbbfffde74f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0467486 Dec 14 03:21:23.169421 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1fda9364-91bb-426f-b34f-67588888b28b req-ad5dd78f-611a-4bba-bc1e-e1dd6c5dd734 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391023 Dec 14 03:21:23.588035 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.261214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-3648a822-da47-4734-8c05-5e129aa5c733 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:24.262656 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-3648a822-da47-4734-8c05-5e129aa5c733 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0471342 Dec 14 03:21:24.282122 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5832529-e0e1-4edc-a32d-29463d03f7a1 req-89a8304c-9443-4f1a-a93e-b4e1b643f20c tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:24.283645 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c5832529-e0e1-4edc-a32d-29463d03f7a1 req-89a8304c-9443-4f1a-a93e-b4e1b643f20c tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=90cacc35-5115-4b8c-b108-eff10fd63c6f HTTP/1.1" status: 200 len: 945 time: 0.0478983 Dec 14 03:21:24.329263 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c5832529-e0e1-4edc-a32d-29463d03f7a1 req-fda84eeb-0c9b-490b-af3f-8e83a4ef7474 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396247 Dec 14 03:21:24.354995 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Deleting port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:21:24.355363 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.439601 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] For port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:21:24.439959 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.451980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling delete_port for dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:21:24.575720 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.579470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.603368 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Pushing event deleted for resources: {'Port': ['ID=dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:24.627142 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.627493 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.627837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.628176 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.628511 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.628840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.629169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.629497 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.629823 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.630145 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.630469 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.630790 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.631144 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:24.651435 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] No DVR routers for this DVR port dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:21:24.653740 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:24.657771 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-9e7914fa-dee9-4517-a62d-4679b04a65a5 req-b03fed82-e724-4469-88c9-2b79cd2a57e4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "DELETE /v2.0/ports/dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb HTTP/1.1" status: 204 len: 173 time: 0.3883893 Dec 14 03:21:24.658216 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'name': 'network-vif-deleted', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:21:24.660980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-519753f4-8126-49bd-815d-8416fe46b1f7" -d '{"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-deleted", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:21:24.696588 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:21:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccb54738-3241-48c1-8cb8-357878cbd3e7 x-openstack-request-id: req-ccb54738-3241-48c1-8cb8-357878cbd3e7 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:21:24.696879 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-deleted", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:21:24.697133 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ccb54738-3241-48c1-8cb8-357878cbd3e7 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:21:24.697589 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90cacc35-5115-4b8c-b108-eff10fd63c6f', 'name': 'network-vif-deleted', 'tag': 'dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb', 'status': 'completed', 'code': 200} Dec 14 03:21:25.798632 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:28.310210 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:21:28.329596 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:21:28.329940 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:21:37.386089 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-906c1c33-cb9c-4857-aa44-a67db0ac0e3f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:37.387431 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-906c1c33-cb9c-4857-aa44-a67db0ac0e3f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 814 time: 0.1032321 Dec 14 03:21:37.402094 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-9e78a21d-5b54-42f0-b312-cd823093c1c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/quotas/325c78a0c8574ce0bb38f768705a1181 HTTP/1.1" status: 200 len: 375 time: 0.0085709 Dec 14 03:21:37.432140 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-f03f8492-f150-481c-b8e1-79302262c164 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249977 Dec 14 03:21:37.728708 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-9d9f3b8e-db52-420b-ade1-e0e59259b403 service neutron] 10.222.0.43 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2895293 Dec 14 03:21:37.822269 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-4eca41c1-e1b0-49d4-8fb8-bdd1126831d7 service neutron] 10.222.0.43 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875258 Dec 14 03:21:37.984884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3fbc7b71-43a6-4b20-9d15-c0f096174dc1 req-7127cc81-0315-43cc-a4a6-ecd6750b11b6 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 210 time: 0.0349612 Dec 14 03:21:39.024369 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-d6749083-b58a-4615-81ef-7932bc17688a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:39.025826 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-d6749083-b58a-4615-81ef-7932bc17688a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 814 time: 0.1017466 Dec 14 03:21:39.061888 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Request body: {'port': {'device_id': '57e0aa27-4adb-426a-9236-0543142651e0', 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8', 'admin_state_up': True, 'tenant_id': '325c78a0c8574ce0bb38f768705a1181'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:39.083333 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 req-e7e50fa7-fdb7-4ee6-bc72-e9fdf0c1efa8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 210 time: 0.0263526 Dec 14 03:21:39.172757 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Made reservation on behalf of 325c78a0c8574ce0bb38f768705a1181 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:21:39.176184 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:39.292998 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Allocated IP 172.20.0.7 (72a1ba60-29fb-46d5-ae0c-f4c2277490a8/9ff8b720-271a-4b6f-88c1-3bac5c3efbdc/0a5dcf35-42a4-4fa6-a151-bf760152d86b) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:21:39.434642 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:39.466825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:39.508612 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:21:39.511661 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:21:39.515271 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:21:39.540323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Pushing event updated for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:39.565207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:39.565816 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:39.581497 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-17549df9-62ee-4e90-afb7-9c8907bc2a7f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5234299 Dec 14 03:21:39.599753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Request body: {'port': {'device_id': '57e0aa27-4adb-426a-9236-0543142651e0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:39.906649 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.148751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0a5dcf35-42a4-4fa6-a151-bf760152d86b {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:21:40.156304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.168202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Transition to ACTIVE for port object 0a5dcf35-42a4-4fa6-a151-bf760152d86b will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:21:40.171470 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.199244 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce004442-19b6-44d6-b83a-97a2f8eaef30 req-1844e8a0-2dc6-4a53-bade-edad0cc6fb8a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:40.201371 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce004442-19b6-44d6-b83a-97a2f8eaef30 req-1844e8a0-2dc6-4a53-bade-edad0cc6fb8a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 931 time: 0.0496356 Dec 14 03:21:40.239222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Pushing event updated for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:40.251442 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce004442-19b6-44d6-b83a-97a2f8eaef30 req-73922ec7-f6ba-4965-84a4-7f25f464e63d tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418484 Dec 14 03:21:40.290318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Attempting to bind port 0a5dcf35-42a4-4fa6-a151-bf760152d86b on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:21:40.290655 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Attempting to bind port 0a5dcf35-42a4-4fa6-a151-bf760152d86b by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:21:40.290980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Attempting to bind port 0a5dcf35-42a4-4fa6-a151-bf760152d86b on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:21:40.295180 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Port 0a5dcf35-42a4-4fa6-a151-bf760152d86b on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:21:40.295499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Attempting to bind port 0a5dcf35-42a4-4fa6-a151-bf760152d86b on network 72a1ba60-29fb-46d5-ae0c-f4c2277490a8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:21:40.300182 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 21, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:21:40.300514 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Checking segment: {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:21:40.300891 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Bound using segment: {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:21:40.301312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Bound port: 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '291bfcba-705b-40e6-839b-25e1bec3a7fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 275, 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:21:40.301657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.360738 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:21:40.364090 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:21:40.368092 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.404768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:40.405384 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:40.406941 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] 10.222.0.20 "PUT /v2.0/ports/0a5dcf35-42a4-4fa6-a151-bf760152d86b HTTP/1.1" status: 200 len: 1093 time: 0.8111205 Dec 14 03:21:40.409202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:21:40.411468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58e1fdbb-271c-466c-8783-c4d42af39c9f" -d '{"events": [{"name": "network-changed", "server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:21:40.435399 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c6ff887-a804-456a-bbd6-023f47409fd6 service neutron] Pushing event updated for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:40.450220 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:21:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 x-openstack-request-id: req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:21:40.450509 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:21:40.450757 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:21:40.451163 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b', 'status': 'completed', 'code': 200} Dec 14 03:21:40.516098 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-4b3d30ca-6255-4ab6-862a-d3eabb198d8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:40.517528 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-4b3d30ca-6255-4ab6-862a-d3eabb198d8f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 1096 time: 0.0397942 Dec 14 03:21:40.563813 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-4bd8db52-3701-4d59-b9c2-cd403be62396 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b HTTP/1.1" status: 200 len: 217 time: 0.0324454 Dec 14 03:21:40.612921 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-0abdc488-b0ee-474e-b6ee-da91388a42ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:40.614283 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-0abdc488-b0ee-474e-b6ee-da91388a42ce service neutron] 10.222.0.20 "GET /v2.0/subnets?id=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc HTTP/1.1" status: 200 len: 854 time: 0.0439737 Dec 14 03:21:40.644431 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-5148a266-b0d1-4e6f-93ff-0778efe1e13d service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0223217 Dec 14 03:21:40.731280 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-9dd11137-c500-4eec-b87f-ec570fb69a0b service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792811 Dec 14 03:21:40.821678 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0012be24-7bf8-4759-a199-0cdb6fd17256 req-444011c9-0ae3-4d89-9b23-3ef26f0d2cff service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831304 Dec 14 03:21:40.948684 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-e9086ea5-edb5-4f7d-ae07-84cbfe0fef4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:40.950122 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-e9086ea5-edb5-4f7d-ae07-84cbfe0fef4c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=325c78a0c8574ce0bb38f768705a1181&device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 1096 time: 0.0394275 Dec 14 03:21:41.040353 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-747d193e-176e-4485-ab5b-9066dd484c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:41.041679 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-747d193e-176e-4485-ab5b-9066dd484c71 service neutron] 10.222.0.20 "GET /v2.0/networks?id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 200 len: 915 time: 0.0840611 Dec 14 03:21:41.083172 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-7835c294-ed7a-4db5-a662-7f0297d51808 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b HTTP/1.1" status: 200 len: 217 time: 0.0336809 Dec 14 03:21:41.130048 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-b9f425be-1017-4655-8dc4-f62eabf38e5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:41.131436 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-b9f425be-1017-4655-8dc4-f62eabf38e5b service neutron] 10.222.0.20 "GET /v2.0/subnets?id=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc HTTP/1.1" status: 200 len: 854 time: 0.0413613 Dec 14 03:21:41.161477 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-44ddf1c2-8592-4592-a0d8-a2ce368a1630 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=72a1ba60-29fb-46d5-ae0c-f4c2277490a8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0228937 Dec 14 03:21:41.239713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:41.250628 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-2b5cee61-5574-4291-b1bf-5b46764b6ef3 service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818155 Dec 14 03:21:41.338394 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-6bad77ea-c5dc-4683-9591-1f1e1deb5156 service neutron] 10.222.0.20 "GET /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805118 Dec 14 03:21:41.363725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 req-00826bfe-ecfb-464c-a6fa-73352f6edf5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:41.365228 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 req-00826bfe-ecfb-464c-a6fa-73352f6edf5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 943 time: 0.0476954 Dec 14 03:21:41.415688 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 req-5d646195-910d-4962-914f-a28178148516 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445974 Dec 14 03:21:42.527932 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f81406b5-7001-455a-8118-c84b21aba2a3 req-6c886d4f-de98-48ac-bfc9-21ab8c424c0a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:42.529362 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f81406b5-7001-455a-8118-c84b21aba2a3 req-6c886d4f-de98-48ac-bfc9-21ab8c424c0a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 943 time: 0.0483673 Dec 14 03:21:42.575268 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f81406b5-7001-455a-8118-c84b21aba2a3 req-04f9e740-497e-4644-801a-597c9c38461f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398538 Dec 14 03:21:43.691300 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865a00bb-a37b-4c81-b5d6-1aad877ba727 req-46fa29c6-ed3b-4401-9511-e6a411fd6d93 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:43.692737 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-865a00bb-a37b-4c81-b5d6-1aad877ba727 req-46fa29c6-ed3b-4401-9511-e6a411fd6d93 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 943 time: 0.0478313 Dec 14 03:21:43.738316 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-865a00bb-a37b-4c81-b5d6-1aad877ba727 req-ff1a2e62-71de-4542-ba08-516238d289ac tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397487 Dec 14 03:21:44.346373 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-369d2959-0b4a-4d20-bc0c-4e153f439962 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0422235 Dec 14 03:21:44.419076 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-47735074-c522-4ce4-9ac6-ed91902b6083 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:44.420535 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-47735074-c522-4ce4-9ac6-ed91902b6083 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 1098 time: 0.0403905 Dec 14 03:21:44.521128 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-6aaf6dbd-5f2e-43c1-9720-571c47a1c781 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:44.522562 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-6aaf6dbd-5f2e-43c1-9720-571c47a1c781 service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.0824978 Dec 14 03:21:44.590142 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-6521bf6e-bac8-4920-94ab-07333a7d89ec service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 200 len: 1001 time: 0.0594833 Dec 14 03:21:44.637691 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-30c08d3f-ba7a-43a7-9abf-4a97e114d2df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:44.638978 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-30c08d3f-ba7a-43a7-9abf-4a97e114d2df service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0412116 Dec 14 03:21:44.684722 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-40c599db-abc6-486f-b537-0afc50696bdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:44.686185 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-40c599db-abc6-486f-b537-0afc50696bdc service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0397916 Dec 14 03:21:44.777098 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-4456ec67-fc99-4d03-8998-cd04e245106a service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830796 Dec 14 03:21:44.854939 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff76226-400a-4698-9633-b84cfcb4397f req-e07e59d2-acd0-4dc3-ac70-9eb2ee623db2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:44.856462 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cff76226-400a-4698-9633-b84cfcb4397f req-e07e59d2-acd0-4dc3-ac70-9eb2ee623db2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 943 time: 0.0503066 Dec 14 03:21:44.865708 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6fa1a97-2282-4af6-8cbb-e1940d00cd75 req-21058cbe-1905-4caf-a3e7-4b44d6f269e5 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806270 Dec 14 03:21:44.902555 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cff76226-400a-4698-9633-b84cfcb4397f req-ed1575ab-f8b8-4a2a-9215-32b9633d28e7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401287 Dec 14 03:21:45.723508 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 0a5dcf35-42a4-4fa6-a151-bf760152d86b details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:21:45.813150 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:21:45.826818 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '0a5dcf35-42a4-4fa6-a151-bf760152d86b', 'network_id': '72a1ba60-29fb-46d5-ae0c-f4c2277490a8', 'port_id': '0a5dcf35-42a4-4fa6-a151-bf760152d86b', 'mac_address': 'fa:16:3e:92:7e:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 275, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ff8b720-271a-4b6f-88c1-3bac5c3efbdc', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:21:45.861765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:45.874603 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0a5dcf35-42a4-4fa6-a151-bf760152d86b {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:21:45.892511 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:21:45.896749 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:45.943511 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:45.950424 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.950801 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.951185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.951530 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.951860 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.952187 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.952514 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.952841 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.953164 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.953488 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.953810 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.954130 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:45.954450 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:46.015987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a226fba6-122d-48f7-a0c2-ef518799ff4a req-be4243d7-39de-4ae7-a482-ec7362a92fb1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:46.017454 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a226fba6-122d-48f7-a0c2-ef518799ff4a req-be4243d7-39de-4ae7-a482-ec7362a92fb1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 944 time: 0.0479939 Dec 14 03:21:46.063184 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a226fba6-122d-48f7-a0c2-ef518799ff4a req-429d73cd-8d44-4cd5-ac3f-3d080570c72d tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395300 Dec 14 03:21:46.381717 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['0a5dcf35-42a4-4fa6-a151-bf760152d86b'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:21:46.996195 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:21:47.173332 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82061095-ce38-4d51-96fc-04d793c04a3b req-df5d6273-86de-464d-8f7e-70b4c484a1af tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:47.174750 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-82061095-ce38-4d51-96fc-04d793c04a3b req-df5d6273-86de-464d-8f7e-70b4c484a1af tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 944 time: 0.0461032 Dec 14 03:21:47.222475 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-82061095-ce38-4d51-96fc-04d793c04a3b req-22afd43c-2ea3-4ec5-99ca-f27bb926f2db tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414715 Dec 14 03:21:47.733998 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 0a5dcf35-42a4-4fa6-a151-bf760152d86b up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:21:47.784153 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 0a5dcf35-42a4-4fa6-a151-bf760152d86b completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:21:47.788101 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 0a5dcf35-42a4-4fa6-a151-bf760152d86b triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:21:47.788507 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:47.871246 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:47.893571 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:21:47.895804 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2846447c-ca66-43fc-95ed-27c616a210b6" -d '{"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-plugged", "status": "completed", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:21:47.908736 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:21:47.913186 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:47.935911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:21:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4cb56180-910e-47a4-992d-bf7669428e3c x-openstack-request-id: req-4cb56180-910e-47a4-992d-bf7669428e3c {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:21:47.936199 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-plugged", "status": "completed", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:21:47.936448 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4cb56180-910e-47a4-992d-bf7669428e3c {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:21:47.936831 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b', 'code': 200} Dec 14 03:21:47.961503 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:48.158934 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8539f98d-0ea5-45f0-9576-eab6ddd2e018 req-1e33ff80-20d8-4e4c-987e-51e765138730 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:48.160437 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8539f98d-0ea5-45f0-9576-eab6ddd2e018 req-1e33ff80-20d8-4e4c-987e-51e765138730 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 1098 time: 0.0437565 Dec 14 03:21:48.204076 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8539f98d-0ea5-45f0-9576-eab6ddd2e018 req-154ad935-cd2d-4d0f-9ea5-20c56bfc4027 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360084 Dec 14 03:21:48.332345 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e68707-47c5-4a3f-8854-173eda16db96 req-2967f09e-4197-441c-b254-0aeee093a95c tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:48.333822 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-11e68707-47c5-4a3f-8854-173eda16db96 req-2967f09e-4197-441c-b254-0aeee093a95c tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0465777 Dec 14 03:21:48.381587 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-11e68707-47c5-4a3f-8854-173eda16db96 req-b429796f-6ef9-47a2-9816-b23a2a613fd4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404141 Dec 14 03:21:49.504014 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c089d5-90ac-4882-8825-113d1c2acd4e req-49491cb4-b4e0-44d5-b6b9-8f955e8e97f2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:49.505431 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b6c089d5-90ac-4882-8825-113d1c2acd4e req-49491cb4-b4e0-44d5-b6b9-8f955e8e97f2 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0489883 Dec 14 03:21:49.549882 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b6c089d5-90ac-4882-8825-113d1c2acd4e req-54403bdf-cdc5-4bbe-9aa8-83273931355a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385931 Dec 14 03:21:49.674456 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-98199866-f3cd-455d-a104-dd8d6f36f30e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:50.186980 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 req-0964f643-7d1a-4ad8-b96b-294a993fab54 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:50.188366 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 req-0964f643-7d1a-4ad8-b96b-294a993fab54 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0511751 Dec 14 03:21:50.233862 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 req-ff971f56-6265-4e2e-8c43-d5e96969613b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396187 Dec 14 03:21:50.662162 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1219be-c78e-4212-8abe-6a54ab8e8671 req-e095106c-1153-4293-bab9-1604d2191397 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:50.663630 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da1219be-c78e-4212-8abe-6a54ab8e8671 req-e095106c-1153-4293-bab9-1604d2191397 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0467956 Dec 14 03:21:50.709977 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-da1219be-c78e-4212-8abe-6a54ab8e8671 req-9f08eea1-88ae-4f39-8e9a-b3da4814d7e8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405407 Dec 14 03:21:51.353578 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0fb602-0d00-4965-999c-ef5c69f8b83c req-35806ca8-aff7-43a0-9738-2d5511cd93ea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:51.355004 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d0fb602-0d00-4965-999c-ef5c69f8b83c req-35806ca8-aff7-43a0-9738-2d5511cd93ea tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0505245 Dec 14 03:21:51.400665 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3d0fb602-0d00-4965-999c-ef5c69f8b83c req-46fe8edb-796e-49b3-aefd-e859fd742784 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395010 Dec 14 03:21:51.873381 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-57940c9f-38ba-4ad4-9dbc-593f3cb9f480 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:52.504974 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-b022c76c-f758-4e5d-905b-51eb4f394831 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:52.506403 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-b022c76c-f758-4e5d-905b-51eb4f394831 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0471871 Dec 14 03:21:52.519913 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccab2886-9279-4c5e-81eb-18c20ef6331a req-378c4a64-c5a8-4f87-a642-0c06839f4a3b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:52.521996 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ccab2886-9279-4c5e-81eb-18c20ef6331a req-378c4a64-c5a8-4f87-a642-0c06839f4a3b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 946 time: 0.0482855 Dec 14 03:21:52.568889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ccab2886-9279-4c5e-81eb-18c20ef6331a req-8ae81cc2-6048-4d39-b20b-0d0e4a1c9fa1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=64e4245c-c105-4dc8-9d60-e655a160fa8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409811 Dec 14 03:21:52.599829 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Deleting port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:21:52.600165 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:52.687898 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] For port 85ceb16f-0c27-48e9-ab76-5cd49eb12802, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=85ceb16f-0c27-48e9-ab76-5cd49eb12802,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:21:52.688185 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:52.900080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:52.900545 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:52.900952 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Floating IP 47c0f7f7-2a66-4b30-b886-e55c11e3c8ab disassociated. External IP: 172.27.3.44, port: 85ceb16f-0c27-48e9-ab76-5cd49eb12802. Dec 14 03:21:52.901393 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling delete_port for 85ceb16f-0c27-48e9-ab76-5cd49eb12802 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:21:53.022818 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:53.050189 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'Port': ['ID=85ceb16f-0c27-48e9-ab76-5cd49eb12802,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:53.164483 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:21:53.266552 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:21:53.276602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:21:53.285670 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:21:53.286283 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:21:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:21:53.305653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] No DVR routers for this DVR port 85ceb16f-0c27-48e9-ab76-5cd49eb12802 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:21:53.308272 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:53.311702 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0fcdc81f-2484-42b9-8a2e-5879bbde284d req-858c3193-4e35-4ca5-acc1-c712be39ef3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "DELETE /v2.0/ports/85ceb16f-0c27-48e9-ab76-5cd49eb12802 HTTP/1.1" status: 204 len: 173 time: 0.7988417 Dec 14 03:21:53.312143 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-deleted', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:21:53.314381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c25c07ab-a292-4c01-aec2-a28208dbb292" -d '{"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-deleted", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:21:53.364237 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:21:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6f05574-8049-41c9-87b2-2d06b4841005 x-openstack-request-id: req-e6f05574-8049-41c9-87b2-2d06b4841005 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:21:53.364603 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-deleted", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:21:53.364862 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e6f05574-8049-41c9-87b2-2d06b4841005 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:21:53.365346 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86395107-d320-45d8-83de-f1848858be10', 'name': 'network-vif-deleted', 'tag': '85ceb16f-0c27-48e9-ab76-5cd49eb12802', 'status': 'completed', 'code': 200} Dec 14 03:21:53.394973 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:21:53.591648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:53.603623 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:21:53.635312 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:21:53.644608 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:21:53.645228 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:21:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:21:53.679763 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-30bdbac3-367d-48ad-8bd5-da340811fddb req-b8dee787-8397-4248-aba1-6ad77be46642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=86395107-d320-45d8-83de-f1848858be10 HTTP/1.1" status: 200 len: 210 time: 0.0257399 Dec 14 03:21:53.754576 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:21:53.957788 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:21:53.983857 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745b514f-57d7-4c0a-886f-e411bd1bfa4d None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:21:54.192883 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a990dba3-3e40-4fa4-b4c6-d83a5908ec73 None None] New status for floating IP 47c0f7f7-2a66-4b30-b886-e55c11e3c8ab: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:21:54.584186 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:54.776461 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56038) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:54.834033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:54.863126 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:54.912596 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:54.915647 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:54.916833 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /v2.0/security-groups/64e4245c-c105-4dc8-9d60-e655a160fa8f HTTP/1.1" status: 204 len: 168 time: 0.1388578 Dec 14 03:21:54.919907 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56040) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:54.926582 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=64e4245c-c105-4dc8-9d60-e655a160fa8f,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:54.934009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.934364 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.934669 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.api.v2.resource [None req-c7934af0-df8c-4b1a-a7ca-aa5bcd46d65e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] show failed (client error): The resource could not be found. Dec 14 03:21:54.934788 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.935035 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.935394 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.935728 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.936054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.936384 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.936708 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.937036 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.937416 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.937748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.938074 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e9316e1-311a-4d40-8435-eeadf469bacb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:21:54.938731 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c7934af0-df8c-4b1a-a7ca-aa5bcd46d65e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups/64e4245c-c105-4dc8-9d60-e655a160fa8f HTTP/1.1" status: 404 len: 347 time: 0.0171516 Dec 14 03:21:54.939310 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56042) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:55.070213 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Deleting port 6d480f1a-494b-4578-ba29-125754b4f142 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:21:55.070564 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.145888 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.146144 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.157390 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling delete_port for 6d480f1a-494b-4578-ba29-125754b4f142 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:21:55.296840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.322298 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'Port': ['ID=6d480f1a-494b-4578-ba29-125754b4f142,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:55.378519 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.381203 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.382888 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-447d1d5e-20b6-4216-a349-781409c3932a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /v2.0/floatingips/47c0f7f7-2a66-4b30-b886-e55c11e3c8ab HTTP/1.1" status: 204 len: 168 time: 0.4418654 Dec 14 03:21:55.716052 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56048) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:55.720676 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group': {'name': 'tempest-securitygroup--92560242', 'description': 'tempest-description--242810527'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:55.745169 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.762000 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:21:55.781997 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 85ceb16f-0c27-48e9-ab76-5cd49eb12802 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:21:55.782344 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 85ceb16f-0c27-48e9-ab76-5cd49eb12802 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:21:55.799996 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.814246 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.817840 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.845225 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.846413 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1292946 Dec 14 03:21:55.849398 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56052) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:55.850336 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b3663b-f830-4a6d-b03d-248067475fd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroup': ['ID=edd17fc9-b72c-450c-8a69-066d081a37b8,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:55.854837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group_rule': {'security_group_id': 'edd17fc9-b72c-450c-8a69-066d081a37b8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:55.881505 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.936929 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.940531 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.959943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7c4f2327-e70c-41b7-aea2-1b6e21596b15,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:55.965672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:55.966848 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-81206822-c316-4fdb-841b-9a435076039d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1162961 Dec 14 03:21:55.969584 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56054) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:55.974086 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'security_group_rule': {'security_group_id': 'edd17fc9-b72c-450c-8a69-066d081a37b8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:55.999573 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.053601 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.057512 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.074412 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31dd5385-64d7-4ddb-b32d-4f7c48017faf,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:56.082556 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.083778 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d41b3622-9f6e-4f2e-bcc6-48447678f6d9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1131501 Dec 14 03:21:56.086849 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56056) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:21:56.091110 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:56.111294 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.205329 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.310251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Allocated IP 172.27.3.212 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/74964162-5f0f-414f-bbec-13b180a53c9a) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:21:56.409567 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.441695 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.477719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:21:56.480560 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:21:56.484020 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:21:56.506488 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=74964162-5f0f-414f-bbec-13b180a53c9a,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:56.569333 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.604779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.743949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.748687 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.813628 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=74964162-5f0f-414f-bbec-13b180a53c9a,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:56.826517 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.841880 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:56.843219 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-87049d70-aa45-4957-93b2-f5380603b98b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7552273 Dec 14 03:21:57.031175 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-a5215f62-9a07-4c5a-86e7-721cca34aca5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--92560242&fields=id&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 267 time: 0.0413830 Dec 14 03:21:57.135460 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-fa8cbabe-bf21-4e15-bef1-eb78bbc32332 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:57.136785 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-fa8cbabe-bf21-4e15-bef1-eb78bbc32332 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 817 time: 0.0990477 Dec 14 03:21:57.151551 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-328f303e-74f8-47c6-bd80-a733cd39dc7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/quotas/da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 375 time: 0.0090368 Dec 14 03:21:57.199263 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-8a916ea5-1ec2-4297-b7fb-7b298d169506 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0425620 Dec 14 03:21:57.291345 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-188d9609-a34a-41ed-abfa-80749e3ae12b service neutron] 10.222.0.43 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808899 Dec 14 03:21:57.379116 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-49ee045c-d64c-48d4-842e-0aad0d861147 service neutron] 10.222.0.43 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817871 Dec 14 03:21:57.539506 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c0dbb584-0604-43ca-ba56-67e13a31a369 req-92f5957d-d3c4-4afb-85c5-8093bbfb99ce tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 210 time: 0.0255077 Dec 14 03:21:58.609138 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-6a04211c-d65c-4014-b589-1cac2baff6db tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:58.610826 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-6a04211c-d65c-4014-b589-1cac2baff6db tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 817 time: 0.1398528 Dec 14 03:21:58.654150 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 req-dc3b12d2-cfed-44dd-bf5f-ae9a3665d782 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 210 time: 0.0288732 Dec 14 03:21:58.687680 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-5e5e9402-78e0-4e09-8178-078addea7f07 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 378 time: 0.0594642 Dec 14 03:21:58.698648 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'port': {'device_id': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'admin_state_up': True, 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'security_groups': ['edd17fc9-b72c-450c-8a69-066d081a37b8']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:21:58.799168 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Made reservation on behalf of da53d564588b46b7bd658659f40a6ded for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:21:58.802534 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:58.922475 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Allocated IP 172.20.0.12 (61e8c126-6b7d-4549-9293-90629e6175d3/8711f032-5b57-4823-aa19-b0e6030552b6/9eee83b0-b14c-403e-a6bd-7d2515f7e214) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:21:59.052099 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:59.085850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:59.129014 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Network 61e8c126-6b7d-4549-9293-90629e6175d3 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:21:59.131997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:21:59.134881 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:21:59.158938 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:21:59.188729 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:59.189351 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:59.207732 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-1c821ee3-0c87-4974-861d-07abf7914136 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5131667 Dec 14 03:21:59.368152 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-51940d1f-2fb3-4dbd-a9e7-42420f8d70dd None None] Provisioning complete for port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:21:59.368719 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-51940d1f-2fb3-4dbd-a9e7-42420f8d70dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:21:59.400730 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-51940d1f-2fb3-4dbd-a9e7-42420f8d70dd None None] Port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:21:59.778253 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fb29ce-78db-418b-af54-31f07ead5a51 req-f3fd53b2-ecc4-4dd2-9801-831c7c756d35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:21:59.779706 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-29fb29ce-78db-418b-af54-31f07ead5a51 req-f3fd53b2-ecc4-4dd2-9801-831c7c756d35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 932 time: 0.0503700 Dec 14 03:21:59.824287 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-29fb29ce-78db-418b-af54-31f07ead5a51 req-32ed30dd-b97b-470c-9bbf-e7e0866a30c1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387409 Dec 14 03:22:00.939351 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e410069-f10a-47a8-8181-4f77bb8f7269 req-dca08e30-05d4-4167-9ebd-82faeb3f9c9f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:00.940783 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e410069-f10a-47a8-8181-4f77bb8f7269 req-dca08e30-05d4-4167-9ebd-82faeb3f9c9f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 932 time: 0.0463002 Dec 14 03:22:00.986533 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6e410069-f10a-47a8-8181-4f77bb8f7269 req-40e04a39-4de0-490e-9fe1-d0760a663a6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393753 Dec 14 03:22:01.914304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Request body: {'port': {'device_id': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:01.964551 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.102265 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6233d3ee-ed17-44e0-8687-1fb02b56d134 req-a883502e-2250-490c-af3c-795bbcc9df25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:02.103750 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6233d3ee-ed17-44e0-8687-1fb02b56d134 req-a883502e-2250-490c-af3c-795bbcc9df25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 932 time: 0.0475719 Dec 14 03:22:02.155123 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6233d3ee-ed17-44e0-8687-1fb02b56d134 req-05bf4fcc-8f74-4b9d-b5c0-bf191171b911 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0454459 Dec 14 03:22:02.470294 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:22:02.477999 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.489646 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Transition to ACTIVE for port object 9eee83b0-b14c-403e-a6bd-7d2515f7e214 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:22:02.493848 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.544409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070531b9-4453-451f-8075-1025120f9871 service neutron] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:02.614513 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Attempting to bind port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:02.614864 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Attempting to bind port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:02.615207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Attempting to bind port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:02.620195 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 on network 61e8c126-6b7d-4549-9293-90629e6175d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:22:02.620517 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Attempting to bind port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 on network 61e8c126-6b7d-4549-9293-90629e6175d3 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:02.625355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 21, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:02.625807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Checking segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:02.626066 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Bound using segment: {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:02.626491 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Bound port: 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1270198f-e0f2-4558-aaef-824767bb1c50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 267, 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:02.626846 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.694921 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:02.697972 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:02.702418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.738735 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:02.739372 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:02.740841 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-070531b9-4453-451f-8075-1025120f9871 service neutron] 10.222.0.20 "PUT /v2.0/ports/9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 1094 time: 0.8307881 Dec 14 03:22:02.741178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:02.743489 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-724789b1-3ca1-45e0-9c1b-10f609bd95d8" -d '{"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:02.773943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070531b9-4453-451f-8075-1025120f9871 service neutron] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:02.782808 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ac65ad6-1420-470a-82c7-60856ace8fb0 x-openstack-request-id: req-0ac65ad6-1420-470a-82c7-60856ace8fb0 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:02.783130 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:02.783412 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0ac65ad6-1420-470a-82c7-60856ace8fb0 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:02.783811 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'status': 'completed', 'code': 200} Dec 14 03:22:03.271725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e06ea42-2cfb-4410-a771-3689dac612fc req-835180f3-66f0-494f-800c-43b4a38adc10 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.273913 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4e06ea42-2cfb-4410-a771-3689dac612fc req-835180f3-66f0-494f-800c-43b4a38adc10 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0484624 Dec 14 03:22:03.318666 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4e06ea42-2cfb-4410-a771-3689dac612fc req-9dc635c5-9665-4e92-899b-5f24f44ed66e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0389733 Dec 14 03:22:03.537416 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-145e3734-c2aa-4195-850b-00d29fd78469 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.538786 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-145e3734-c2aa-4195-850b-00d29fd78469 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1097 time: 0.0397136 Dec 14 03:22:03.653367 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-f91c6218-86ba-4be2-8906-c03c8e8ec57d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.654820 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-f91c6218-86ba-4be2-8906-c03c8e8ec57d service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=da53d564588b46b7bd658659f40a6ded&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0909753 Dec 14 03:22:03.751639 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-044d47e4-d25a-4d6f-a192-9993f6261780 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.753079 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-044d47e4-d25a-4d6f-a192-9993f6261780 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0906277 Dec 14 03:22:03.852020 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-cde8ea0c-195f-4cea-8201-1abec64bc963 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.853463 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-cde8ea0c-195f-4cea-8201-1abec64bc963 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1097 time: 0.0392313 Dec 14 03:22:03.900728 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-8a290160-b68b-4781-8883-9f9eb0cdeb66 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 217 time: 0.0319297 Dec 14 03:22:03.950708 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-78e39208-812b-4d34-a88e-2844fec8fcca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:03.952153 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-78e39208-812b-4d34-a88e-2844fec8fcca service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0431011 Dec 14 03:22:04.007618 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f06e418-00e0-4aa1-a937-904243101829 req-248a8517-e610-4f15-aca8-9a30fee06fdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:04.009075 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-248a8517-e610-4f15-aca8-9a30fee06fdc service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477138 Dec 14 03:22:04.103871 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-28812dae-d54c-4ee6-a458-18c639d0c42f service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873098 Dec 14 03:22:04.192497 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1f06e418-00e0-4aa1-a937-904243101829 req-847f9073-dcb9-4669-99f0-6dd2d9bc3fa5 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813866 Dec 14 03:22:04.436492 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a49f5fe-f8af-4c94-9574-1a730652204a req-332f0a22-4524-414f-a398-23600cab56f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:04.437933 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0a49f5fe-f8af-4c94-9574-1a730652204a req-332f0a22-4524-414f-a398-23600cab56f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0479877 Dec 14 03:22:04.483479 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0a49f5fe-f8af-4c94-9574-1a730652204a req-ec93a5f7-288e-4799-b356-1ef4e742fb3c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396590 Dec 14 03:22:05.602214 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708f1983-2383-4d42-a298-ce0ebad69bc9 req-822a59f8-0d45-4eb0-a9aa-3919e0a14e68 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:05.603746 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-708f1983-2383-4d42-a298-ce0ebad69bc9 req-822a59f8-0d45-4eb0-a9aa-3919e0a14e68 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0503170 Dec 14 03:22:05.648842 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-708f1983-2383-4d42-a298-ce0ebad69bc9 req-e31ade26-4ce1-412f-bf61-3eed4340df9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393305 Dec 14 03:22:06.765023 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebb7249-9b80-4ea5-ab57-79997af38048 req-157bc9b0-641f-4fd0-a9db-4e9b077030f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:06.766471 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4ebb7249-9b80-4ea5-ab57-79997af38048 req-157bc9b0-641f-4fd0-a9db-4e9b077030f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0478196 Dec 14 03:22:06.812276 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4ebb7249-9b80-4ea5-ab57-79997af38048 req-781b49ce-89e2-4c9e-b2e2-c048d5a4f635 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0399823 Dec 14 03:22:07.931012 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe488376-8a5c-4342-a054-e60d4342a622 req-582f4667-5bb1-4d04-a39c-36bf0361f5b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:07.932496 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fe488376-8a5c-4342-a054-e60d4342a622 req-582f4667-5bb1-4d04-a39c-36bf0361f5b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0509422 Dec 14 03:22:07.979194 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fe488376-8a5c-4342-a054-e60d4342a622 req-16449779-663c-4733-94f9-bcd77020ed91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409961 Dec 14 03:22:09.092408 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c104f78c-00dd-463a-ab4f-64d7d18a9acb req-5ba6e6e8-25dd-4254-b814-2edc992e0060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:09.093837 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c104f78c-00dd-463a-ab4f-64d7d18a9acb req-5ba6e6e8-25dd-4254-b814-2edc992e0060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0463550 Dec 14 03:22:09.139520 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c104f78c-00dd-463a-ab4f-64d7d18a9acb req-a0a229d9-67a0-468a-a2d2-998b0901421b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0397582 Dec 14 03:22:10.260259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca07a093-95b5-403a-9240-06a84a3e8905 req-120af72b-6eaa-4edd-a659-309d20e90cd0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:10.261651 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ca07a093-95b5-403a-9240-06a84a3e8905 req-120af72b-6eaa-4edd-a659-309d20e90cd0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0497615 Dec 14 03:22:10.311862 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ca07a093-95b5-403a-9240-06a84a3e8905 req-e17bc260-b268-4ea1-8155-7cdd09247263 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0439441 Dec 14 03:22:11.257889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:11.429820 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 req-37e1943a-58ae-478f-8aa1-ab4eb8242dd3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:11.431284 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 req-37e1943a-58ae-478f-8aa1-ab4eb8242dd3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0468967 Dec 14 03:22:11.476960 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 req-a3090c43-5b40-4119-b911-f4cd46d43807 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0399306 Dec 14 03:22:11.920917 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:22:12.014665 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:12.026379 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:22:12.061705 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:12.074435 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:22:12.093387 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:12.097753 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:12.143791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:12.545473 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9eee83b0-b14c-403e-a6bd-7d2515f7e214'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:12.593672 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a747193b-f9e4-436a-9856-922030d51aad req-dc5c37cc-68fc-4ad1-8dca-5eb9737d3289 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:12.595149 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a747193b-f9e4-436a-9856-922030d51aad req-dc5c37cc-68fc-4ad1-8dca-5eb9737d3289 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0464985 Dec 14 03:22:12.642692 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a747193b-f9e4-436a-9856-922030d51aad req-5801f581-d13b-4859-9e27-131cfe3b5fa3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409944 Dec 14 03:22:13.762704 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e58299-1e0f-44b5-882a-88ed4d4b9589 req-1cc6a4da-d04f-45de-be0b-6211ce3684b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:13.764226 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-01e58299-1e0f-44b5-882a-88ed4d4b9589 req-1cc6a4da-d04f-45de-be0b-6211ce3684b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0499516 Dec 14 03:22:13.808824 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-01e58299-1e0f-44b5-882a-88ed4d4b9589 req-eeb35122-a493-4033-8b0c-54228ca3e31b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0388725 Dec 14 03:22:13.936400 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:13.981297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:22:13.984919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:13.985283 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:14.062719 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:14.084397 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:14.086638 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-229d1e64-6d90-498f-a68f-c67c7cfc44f5" -d '{"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:14.099153 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:14.103623 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:14.128971 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db8a84cb-0661-44c9-bfa4-4714b83253ba x-openstack-request-id: req-db8a84cb-0661-44c9-bfa4-4714b83253ba {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:14.129265 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:14.129518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-db8a84cb-0661-44c9-bfa4-4714b83253ba {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:14.129908 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'code': 200} Dec 14 03:22:14.154536 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:14.347833 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9266581-ffa0-459b-8210-42ff806896ee req-0c084386-bd76-44ab-b2a6-55450e795fa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:14.349197 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b9266581-ffa0-459b-8210-42ff806896ee req-0c084386-bd76-44ab-b2a6-55450e795fa1 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1099 time: 0.0390503 Dec 14 03:22:14.396140 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b9266581-ffa0-459b-8210-42ff806896ee req-3dd5d94a-2986-438d-9283-8609fefdaeda service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0379660 Dec 14 03:22:14.741478 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160abed3-690d-4359-9ff9-a30434a0ed83 req-93d4a591-c894-40ca-945c-d7e6f79274d3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:14.743094 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-160abed3-690d-4359-9ff9-a30434a0ed83 req-93d4a591-c894-40ca-945c-d7e6f79274d3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0474927 Dec 14 03:22:14.788415 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-160abed3-690d-4359-9ff9-a30434a0ed83 req-cd179e71-95bb-46b2-b284-9d7fb7c9c1f4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389059 Dec 14 03:22:14.932163 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 req-b7eac907-f0d8-4e14-9508-e218b0404ec2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:14.933743 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 req-b7eac907-f0d8-4e14-9508-e218b0404ec2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0519607 Dec 14 03:22:14.983536 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 req-45114038-b58a-445d-888f-1463c8208cfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0439496 Dec 14 03:22:15.899723 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-862657dd-caad-4874-9c5a-f2048c06e9dd req-3384432e-841a-47c2-a8ed-8b61b6528df4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:15.901183 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-862657dd-caad-4874-9c5a-f2048c06e9dd req-3384432e-841a-47c2-a8ed-8b61b6528df4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0472126 Dec 14 03:22:15.948117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-862657dd-caad-4874-9c5a-f2048c06e9dd req-6c1c3cbc-934b-487c-ae7f-619c9e8fc139 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405998 Dec 14 03:22:16.100269 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a req-0e70ca7d-8793-485a-b555-cbaa49cbf473 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:16.102215 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a req-0e70ca7d-8793-485a-b555-cbaa49cbf473 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0472021 Dec 14 03:22:16.148693 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a req-52ddf1a0-a0d8-4c60-b1f8-ddb1b7c2a116 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0405087 Dec 14 03:22:17.064637 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c460f2f-f24e-4146-9724-974243f7cce5 req-d74fac1c-534a-486a-8b4c-1121cf0f6687 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:17.066063 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c460f2f-f24e-4146-9724-974243f7cce5 req-d74fac1c-534a-486a-8b4c-1121cf0f6687 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0500722 Dec 14 03:22:17.111810 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c460f2f-f24e-4146-9724-974243f7cce5 req-a8f6cefa-739a-40db-8e42-d0658c07b3ce tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/security-groups?id=dec61bef-9218-413c-b74e-76a85a176263&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393090 Dec 14 03:22:17.265872 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16947703-7e08-4c52-a5cc-96232a87aa97 req-53b7a9dc-2f4b-4eb1-8768-28f3c0f0fe50 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:17.267240 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-16947703-7e08-4c52-a5cc-96232a87aa97 req-53b7a9dc-2f4b-4eb1-8768-28f3c0f0fe50 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0471792 Dec 14 03:22:17.312126 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-16947703-7e08-4c52-a5cc-96232a87aa97 req-68eb7b66-d171-4348-b258-9a969f90862b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0391984 Dec 14 03:22:17.427199 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba req-0a218c75-be35-4e15-852b-ef68d451f2a1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:17.429161 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba req-0a218c75-be35-4e15-852b-ef68d451f2a1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0507424 Dec 14 03:22:17.437553 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56208) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:17.441797 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Request body: {'floatingip': {'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:17.479976 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.509413 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-680ac39f-0cfe-42fe-8282-f78bacd08088 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:17.510837 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-680ac39f-0cfe-42fe-8282-f78bacd08088 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 945 time: 0.0479331 Dec 14 03:22:17.603851 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Deleting port 0a5dcf35-42a4-4fa6-a151-bf760152d86b {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:17.604269 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.697979 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] For port 0a5dcf35-42a4-4fa6-a151-bf760152d86b, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=0a5dcf35-42a4-4fa6-a151-bf760152d86b,segment=NetworkSegment(291bfcba-705b-40e6-839b-25e1bec3a7fe),segment_id=291bfcba-705b-40e6-839b-25e1bec3a7fe)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:17.698338 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.710544 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling delete_port for 0a5dcf35-42a4-4fa6-a151-bf760152d86b owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:17.837971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.866423 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Pushing event deleted for resources: {'Port': ['ID=0a5dcf35-42a4-4fa6-a151-bf760152d86b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:17.878878 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['0a5dcf35-42a4-4fa6-a151-bf760152d86b'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:17.911757 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] No DVR routers for this DVR port 0a5dcf35-42a4-4fa6-a151-bf760152d86b on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:17.914329 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.917875 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 req-63147029-24bf-43c0-96ee-dd661e19644b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.20 "DELETE /v2.0/ports/0a5dcf35-42a4-4fa6-a151-bf760152d86b HTTP/1.1" status: 204 len: 173 time: 0.4003737 Dec 14 03:22:17.918394 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'name': 'network-vif-deleted', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:17.920719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe2ee5f4-3966-499e-b896-b7bb6776fb24" -d '{"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-deleted", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:17.932424 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.937343 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:17.961676 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1faaa281-04a7-4dc8-b9d6-79747101d6ae x-openstack-request-id: req-1faaa281-04a7-4dc8-b9d6-79747101d6ae {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:17.962002 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-deleted", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:17.962249 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1faaa281-04a7-4dc8-b9d6-79747101d6ae {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:17.962640 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '57e0aa27-4adb-426a-9236-0543142651e0', 'name': 'network-vif-deleted', 'tag': '0a5dcf35-42a4-4fa6-a151-bf760152d86b', 'status': 'completed', 'code': 200} Dec 14 03:22:18.041470 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Floating IP c58214ba-c405-42fb-9d95-053336465a20 associated. External IP: 172.27.3.212, port: 9eee83b0-b14c-403e-a6bd-7d2515f7e214. Dec 14 03:22:18.248769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-31caaf95-0c19-45eb-9d14-c3ce3feae573 req-915a6dfb-74a9-4baa-a598-d81abd15ecbf tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /v2.0/ports?device_id=57e0aa27-4adb-426a-9236-0543142651e0 HTTP/1.1" status: 200 len: 210 time: 0.0543518 Dec 14 03:22:18.269753 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:18.589413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:18.594173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:18.600049 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:18.609702 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:18.610321 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:21:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:18.620823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-102d06c9-3d88-405a-a385-79353122fcdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "PUT /v2.0/floatingips/c58214ba-c405-42fb-9d95-053336465a20 HTTP/1.1" status: 200 len: 992 time: 1.1822350 Dec 14 03:22:18.621417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:18.623815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b" -d '{"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:18.719429 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:18.783454 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b x-openstack-request-id: req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:18.783738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:18.783981 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:18.784370 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'status': 'completed', 'code': 200} Dec 14 03:22:18.868347 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4af037ee-5014-464f-a49d-38903755fabb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:18.869833 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4af037ee-5014-464f-a49d-38903755fabb service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1099 time: 0.0401766 Dec 14 03:22:18.957164 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-5a642695-db73-4526-a343-b962b6109db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:18.958609 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-5a642695-db73-4526-a343-b962b6109db1 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0812981 Dec 14 03:22:18.981254 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'c58214ba-c405-42fb-9d95-053336465a20', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.212', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:21:56Z', 'updated_at': '2021-12-14T03:22:17Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:19.005998 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:19.014794 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:19.015450 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:21:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:19.026060 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-0e69e041-ced1-44b0-ba2e-237196fee119 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 1000 time: 0.0604560 Dec 14 03:22:19.080587 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-7fa6a3d1-4940-47cb-bd6b-7cbc630f3449 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:19.082021 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-7fa6a3d1-4940-47cb-bd6b-7cbc630f3449 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0496740 Dec 14 03:22:19.119788 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:19.127476 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-a022f37c-6af4-4807-bc23-79d72825781b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:19.128961 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-a022f37c-6af4-4807-bc23-79d72825781b service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392621 Dec 14 03:22:19.219938 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-e70103e5-5022-46fd-ad87-b714de4caf5a service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829148 Dec 14 03:22:19.312226 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-e1862663-085a-4da7-a895-1a73a890e71d service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848141 Dec 14 03:22:19.342816 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'c58214ba-c405-42fb-9d95-053336465a20', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.212', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:21:56Z', 'updated_at': '2021-12-14T03:22:17Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:19.371459 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aaf5827b-ff04-4a0c-a5b6-5ea4f188ea3f None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': 'c58214ba-c405-42fb-9d95-053336465a20', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'floating_ip_address': '172.27.3.212', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:21:56Z', 'updated_at': '2021-12-14T03:22:17Z', 'revision_number': 1, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:19.588742 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebe27593-39ee-40d8-8fa4-bbd0bfe31723 None None] New status for floating IP c58214ba-c405-42fb-9d95-053336465a20: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:22:19.676243 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-db736539-d2dd-4928-80ac-9a31b6639972 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:19.948043 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 0a5dcf35-42a4-4fa6-a151-bf760152d86b no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:19.967895 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 0a5dcf35-42a4-4fa6-a151-bf760152d86b {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:19.968235 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 0a5dcf35-42a4-4fa6-a151-bf760152d86b not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:21.874909 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-785cb616-aac7-41c0-b271-34a550f15684 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:23.594559 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:23.994981 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:22:24.586131 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:25.587584 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-92a1de91-03a0-43f7-badd-826580d7e740 req-3a9f6cbe-5fa6-445a-a207-e79a4d6235d4 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-309499008&fields=id&tenant_id=bc2e5ee76edf4e358f418773bf824ed7 HTTP/1.1" status: 200 len: 267 time: 0.0432546 Dec 14 03:22:25.640084 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a1de91-03a0-43f7-badd-826580d7e740 req-8dfa701e-eda8-49ce-84ef-8c411452e52a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:25.641534 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-92a1de91-03a0-43f7-badd-826580d7e740 req-8dfa701e-eda8-49ce-84ef-8c411452e52a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 985 time: 0.0483296 Dec 14 03:22:25.652200 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Request body: {'port': {'security_groups': ['c5aea58c-8de2-497c-802a-0d4e5575f808']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:25.722018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:25.801984 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:25.839334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 req-bd508eb0-132b-4797-9b64-69ebf3396216 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:25.840799 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 req-bd508eb0-132b-4797-9b64-69ebf3396216 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0838666 Dec 14 03:22:25.953120 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 req-8b248bb2-9ad2-4431-8a05-46c93564d962 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1033392 Dec 14 03:22:25.965221 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:25.997457 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.003424 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.054947 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:26.055131 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:26.055673 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.063135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56274) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:26.063619 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-92a1de91-03a0-43f7-badd-826580d7e740 req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "PUT /v2.0/ports/bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 943 time: 0.4152808 Dec 14 03:22:26.066190 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:26.068546 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:26.097738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e777e15b-ec7d-4a86-9b10-20f51001ae11 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event updated for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=7']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:26.148805 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-957c8b3d-d30f-4e4d-b96e-f0080a71333b x-openstack-request-id: req-957c8b3d-d30f-4e4d-b96e-f0080a71333b {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:26.149086 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:26.149347 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-957c8b3d-d30f-4e4d-b96e-f0080a71333b {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:26.149745 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:22:26.150156 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.183807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.286380 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-652e9d32-67a9-4079-8c30-487aed8f51f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:26.288049 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-652e9d32-67a9-4079-8c30-487aed8f51f2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1099 time: 0.0547690 Dec 14 03:22:26.295256 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.299491 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.300307 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:26.304279 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /v2.0/security-groups/fa44b3d3-acb1-44ee-af7e-bffca3aa686e HTTP/1.1" status: 204 len: 168 time: 0.2358692 Dec 14 03:22:26.305310 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56282) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:26.365785 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa44b3d3-acb1-44ee-af7e-bffca3aa686e,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:26.376570 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-940cf977-17ae-48a1-a939-7f598fc515a7 None None] Provisioning complete for port bb3c28d2-c03d-4924-8dd8-da975e5427e4 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:26.376934 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-940cf977-17ae-48a1-a939-7f598fc515a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.387714 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.388048 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.388421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.388741 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.389069 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.389405 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.389737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.390066 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.390396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.390725 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.391069 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.391431 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.391833 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef55e8ba-f21c-4c1f-a49f-046b667ee7c5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:26.523115 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-f668171a-056d-4b76-9510-9dafcb5d9cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:26.524559 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-f668171a-056d-4b76-9510-9dafcb5d9cc1 service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.2019830 Dec 14 03:22:26.609154 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-4721d84d-2c1c-47fb-9b0d-b01234557fe9 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 1002 time: 0.0673287 Dec 14 03:22:26.617505 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Deleting port eec32e42-0479-4a31-8d39-d995304b6cb2 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:26.617839 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.700949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-9a93419f-5921-4a35-998c-ae39fc98f9a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:26.702307 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-9a93419f-5921-4a35-998c-ae39fc98f9a5 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0819726 Dec 14 03:22:26.732406 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.732731 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:26.762868 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling delete_port for eec32e42-0479-4a31-8d39-d995304b6cb2 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:26.817345 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-ec680d4c-0957-42e7-a75b-51b0b5067809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:26.819364 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-ec680d4c-0957-42e7-a75b-51b0b5067809 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0976923 Dec 14 03:22:26.960323 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-7e49e59a-0ecc-45d6-856b-7583c63d5479 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269426 Dec 14 03:22:27.070372 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:27.074450 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 req-76b54b02-8ad7-46f6-9d49-0853ae993cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.077078 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 req-76b54b02-8ad7-46f6-9d49-0853ae993cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0514839 Dec 14 03:22:27.127209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event deleted for resources: {'Port': ['ID=eec32e42-0479-4a31-8d39-d995304b6cb2,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:27.132290 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 req-d55d13ee-d81d-463b-8eca-a126f19499bb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477359 Dec 14 03:22:27.136041 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-31bbec29-101f-4306-b7d2-fa0a793a7b2a service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1686480 Dec 14 03:22:27.175924 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:27.176329 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Floating IP bd0e6ea6-d92a-472e-bfe1-9a23ceee8930 disassociated (deleted). External IP: 172.27.3.143, port: bb3c28d2-c03d-4924-8dd8-da975e5427e4. Dec 14 03:22:27.373943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:27.486621 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:27.492013 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:27.498160 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Sync routers for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:27.509681 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:27.510521 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:27.526419 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5b62dc24-bd7a-474f-b8f6-f3a8c9bf1577 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /v2.0/floatingips/bd0e6ea6-d92a-472e-bfe1-9a23ceee8930 HTTP/1.1" status: 204 len: 168 time: 1.2157109 Dec 14 03:22:27.526419 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:27.531880 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e42b1104-7e8c-4f91-bbb4-4c9070880992" -d '{"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:27.570132 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5787124-db7b-48d8-b3b1-4e3fdd914122 x-openstack-request-id: req-c5787124-db7b-48d8-b3b1-4e3fdd914122 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:27.570429 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:27.570682 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c5787124-db7b-48d8-b3b1-4e3fdd914122 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:27.571106 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:22:27.617094 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:27.677330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-0e041afb-6c8b-4776-b55d-9af0e8a1c475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.679385 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-0e041afb-6c8b-4776-b55d-9af0e8a1c475 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 1099 time: 0.0465858 Dec 14 03:22:27.794728 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c308444a-04b0-4edd-8912-855091d4baa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.796235 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c308444a-04b0-4edd-8912-855091d4baa8 service neutron] 10.222.0.20 "GET /v2.0/networks?id=f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 200 len: 915 time: 0.1085284 Dec 14 03:22:27.835571 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:27.867394 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Checking router: 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:27.876798 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:27.877430 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:27.889564 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-4da2fd03-c3a2-4185-af40-900dfd798262 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 200 len: 217 time: 0.0448980 Dec 14 03:22:27.901231 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-38dbaebc-122d-4b9b-b85e-04a2d983a6d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.902904 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-38dbaebc-122d-4b9b-b85e-04a2d983a6d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.0589764 Dec 14 03:22:27.939554 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-a8de08e6-983f-430a-acc1-bc3734db18dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.940989 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-a8de08e6-983f-430a-acc1-bc3734db18dd service neutron] 10.222.0.20 "GET /v2.0/subnets?id=4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 200 len: 853 time: 0.0443108 Dec 14 03:22:27.985312 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:27.996335 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-76750116-df63-4de2-8905-5e57dec25be0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:27.997819 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-76750116-df63-4de2-8905-5e57dec25be0 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=f2ccc364-1044-4d86-92a1-159741b0fffd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415933 Dec 14 03:22:28.021961 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Deleting port b1d9bd41-b159-47f7-8b8c-3145159e82db {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:28.022483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.097033 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-2289f191-5f11-4ad3-89aa-cfcf27955595 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908635 Dec 14 03:22:28.126925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] For port b1d9bd41-b159-47f7-8b8c-3145159e82db, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=b1d9bd41-b159-47f7-8b8c-3145159e82db,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:28.127589 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.197840 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-35ad99b1-5c4a-451a-b45c-4168a9dde607 service neutron] 10.222.0.20 "GET /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924828 Dec 14 03:22:28.326713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:28.327342 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b142a4-912a-4812-804c-3f4bdc0801ca req-53d43219-1af0-4c83-843d-71674d771031 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:28.328853 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97b142a4-912a-4812-804c-3f4bdc0801ca req-53d43219-1af0-4c83-843d-71674d771031 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 945 time: 0.1233087 Dec 14 03:22:28.353694 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62330738-fb88-45c9-a41e-0ef816d712f7 None None] The sync data for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi is: [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:16:45Z', 'revision_number': 4, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '1f1825d8-5cf4-485e-a2c8-2412e7b8f483', 'name': '', 'network_id': 'f2ccc364-1044-4d86-92a1-159741b0fffd', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'mac_address': 'fa:16:3e:f8:52:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:45Z', 'updated_at': '2021-12-14T03:16:49Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'subnets': [{'id': '4b4783ac-1363-4237-9ce6-75efb61eaefb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:28.442390 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97b142a4-912a-4812-804c-3f4bdc0801ca req-70cda54a-0d86-4ffc-83f7-16a10d089897 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=47a97fb2-30c0-4223-91ff-a553b95b2269&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963700 Dec 14 03:22:28.447532 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.447900 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.448215 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Floating IP d09cc663-920e-4f9d-a375-bf08cb916c05 disassociated. External IP: 172.27.3.234, port: b1d9bd41-b159-47f7-8b8c-3145159e82db. Dec 14 03:22:28.448555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling delete_port for b1d9bd41-b159-47f7-8b8c-3145159e82db owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:28.587493 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c125b3c-2486-48df-ad81-c8b1eda251e6 None None] New status for floating IP bd0e6ea6-d92a-472e-bfe1-9a23ceee8930: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:22:28.591435 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.634650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'Port': ['ID=b1d9bd41-b159-47f7-8b8c-3145159e82db,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:28.800738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:28.932057 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:28.943784 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:28.962600 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:28.963664 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:28.985844 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] No DVR routers for this DVR port b1d9bd41-b159-47f7-8b8c-3145159e82db on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:28.989259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:28.993026 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 req-85539f11-f27c-4c0a-802f-52cba24a1378 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "DELETE /v2.0/ports/b1d9bd41-b159-47f7-8b8c-3145159e82db HTTP/1.1" status: 204 len: 173 time: 1.0615945 Dec 14 03:22:28.993590 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'name': 'network-vif-deleted', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:28.996553 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16" -d '{"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-deleted", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:29.046618 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 x-openstack-request-id: req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:29.046972 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-deleted", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:29.047650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:29.050000 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd35b83c-0304-43fc-85ec-731c395d3364', 'name': 'network-vif-deleted', 'tag': 'b1d9bd41-b159-47f7-8b8c-3145159e82db', 'status': 'completed', 'code': 200} Dec 14 03:22:29.104784 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:29.309352 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:29.334740 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:29.342579 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:29.343213 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:29.446077 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:29.550279 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 req-6b38561a-0a72-4b25-8154-2e49e7a79798 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=fd35b83c-0304-43fc-85ec-731c395d3364 HTTP/1.1" status: 200 len: 210 time: 0.0256820 Dec 14 03:22:29.648144 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:29.674897 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7caceca-c8e4-452a-86a0-c68c8ef198c9 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:29.876777 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cb4603c-af6c-4dd3-9b5c-e3514e916175 None None] New status for floating IP d09cc663-920e-4f9d-a375-bf08cb916c05: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:22:30.321390 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 req-ce642224-6916-4027-a41f-e82226d9f53e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:30.322807 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 req-ce642224-6916-4027-a41f-e82226d9f53e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0462439 Dec 14 03:22:30.369003 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 req-b79f78a3-9246-4f84-aec6-72438db92673 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401866 Dec 14 03:22:30.633292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56352) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:30.685268 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.707804 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.756324 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.758909 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.760060 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /v2.0/security-groups/47a97fb2-30c0-4223-91ff-a553b95b2269 HTTP/1.1" status: 204 len: 168 time: 0.1257870 Dec 14 03:22:30.762827 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56354) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:30.768829 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acec0809-7a3f-428c-9a73-d16d074be92a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=47a97fb2-30c0-4223-91ff-a553b95b2269,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:30.775454 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.api.v2.resource [None req-3aede799-b531-4767-8d9e-12012a3fa06a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] show failed (client error): The resource could not be found. Dec 14 03:22:30.776658 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3aede799-b531-4767-8d9e-12012a3fa06a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups/47a97fb2-30c0-4223-91ff-a553b95b2269 HTTP/1.1" status: 404 len: 347 time: 0.0128453 Dec 14 03:22:30.779616 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56356) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:30.900502 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Deleting port e0d95a0b-26cf-4d82-a318-74e54e3d59bf {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:30.900834 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.970939 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.971304 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:30.982874 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling delete_port for e0d95a0b-26cf-4d82-a318-74e54e3d59bf owned by network:floatingip {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:31.115833 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.139756 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'Port': ['ID=e0d95a0b-26cf-4d82-a318-74e54e3d59bf,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:31.201317 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.203894 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.205021 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a8fe1221-4c7d-4969-8cde-a389e9155c04 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /v2.0/floatingips/d09cc663-920e-4f9d-a375-bf08cb916c05 HTTP/1.1" status: 204 len: 168 time: 0.4246118 Dec 14 03:22:31.721156 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56364) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:31.725538 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group': {'name': 'tempest-securitygroup--976752068', 'description': 'tempest-description--1882657385'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:31.749216 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.808303 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-159cdfae-6b00-4e24-bb71-01ab030da24d req-3d4549f8-b82d-4103-86d1-8604ed24c55f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:31.810454 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-159cdfae-6b00-4e24-bb71-01ab030da24d req-3d4549f8-b82d-4103-86d1-8604ed24c55f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0496609 Dec 14 03:22:31.815318 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.819768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.849586 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.850786 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1288064 Dec 14 03:22:31.852698 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f025508c-a0cc-40cb-858f-a0e135877dc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82422a55-c106-4735-9c53-08650620c7f6,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:31.853928 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56366) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:31.858276 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group_rule': {'security_group_id': '82422a55-c106-4735-9c53-08650620c7f6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:31.871933 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-159cdfae-6b00-4e24-bb71-01ab030da24d req-010219a4-4de5-46b8-b656-846ba1cce29a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550320 Dec 14 03:22:31.892310 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.945665 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.949187 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.966128 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=473d94bb-c8be-46a7-86b9-aabb5e272f34,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:31.973376 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:31.974576 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d03e3b5c-4991-453b-be62-4f22e4653dca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1197412 Dec 14 03:22:31.977237 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56368) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:31.981487 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'security_group_rule': {'security_group_id': '82422a55-c106-4735-9c53-08650620c7f6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:32.007290 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.072346 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.075770 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.092642 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8639afe-70fa-4228-9ad1-eb549ec77f35,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:32.101986 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.103194 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-be67aab9-a425-4174-b314-b96245581a3d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1249831 Dec 14 03:22:32.106187 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56370) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:32.110322 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:32.136682 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.230384 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.331752 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Allocated IP 172.27.3.30 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/52462e29-485d-4a69-b335-297e5b5db116) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:32.429453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.461967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.501739 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:32.504484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:32.508498 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:32.531533 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=52462e29-485d-4a69-b335-297e5b5db116,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:32.594773 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.626933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.772496 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.776739 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.842020 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=52462e29-485d-4a69-b335-297e5b5db116,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:32.851425 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.866771 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:32.868010 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-cd379bbd-4b05-40f5-913f-3addfa0a84a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.7608829 Dec 14 03:22:32.988812 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0279fc7a-c39d-4556-931d-312d27c8d1c8 req-05a073fc-fba6-4214-bfb2-a89dcdaa0b2e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:32.990906 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0279fc7a-c39d-4556-931d-312d27c8d1c8 req-05a073fc-fba6-4214-bfb2-a89dcdaa0b2e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0516281 Dec 14 03:22:33.035135 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0279fc7a-c39d-4556-931d-312d27c8d1c8 req-9a454b7e-86d6-499a-8835-b678fe3d1d9b tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383193 Dec 14 03:22:33.146494 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-74c5741d-ac3e-4bef-9ed0-18161d04b839 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--976752068&fields=id&tenant_id=11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 267 time: 0.0419021 Dec 14 03:22:33.251261 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-adc71970-e7e6-4529-a08c-6a86b44fa9ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:33.252702 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-adc71970-e7e6-4529-a08c-6a86b44fa9ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 810 time: 0.0996122 Dec 14 03:22:33.266764 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-567b084a-75d9-470e-af33-317d72fe3980 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/quotas/11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 375 time: 0.0085249 Dec 14 03:22:33.315521 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-cd5232ac-43e0-4f31-8549-9e25a06d56db tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0437841 Dec 14 03:22:33.494303 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-df0d888b-338f-42b6-b087-8463c6ad29b2 service neutron] 10.222.0.43 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1677322 Dec 14 03:22:33.583126 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-e04d56c2-2af4-45fe-a876-2568b8190087 service neutron] 10.222.0.43 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827835 Dec 14 03:22:33.737052 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-67692ee9-aa1d-436a-acaa-eb9e25b9d57b req-c81bc9eb-140d-47e2-a26a-93e910e2b00c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 210 time: 0.0257514 Dec 14 03:22:34.148343 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f33e85-57f6-4d40-b693-3f18bc354657 req-71a4453a-d405-4dd6-8640-8998f26d326c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:34.149715 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-03f33e85-57f6-4d40-b693-3f18bc354657 req-71a4453a-d405-4dd6-8640-8998f26d326c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0474403 Dec 14 03:22:34.195520 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-03f33e85-57f6-4d40-b693-3f18bc354657 req-f7cbcb17-565d-42ad-8098-1f20edc57ac4 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397890 Dec 14 03:22:34.447961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b1d9bd41-b159-47f7-8b8c-3145159e82db no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:34.467085 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: b1d9bd41-b159-47f7-8b8c-3145159e82db {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:34.467412 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device b1d9bd41-b159-47f7-8b8c-3145159e82db not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:35.040561 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68352ff7-25d6-43ce-8769-fa13e0a75670 req-ad5a4696-0775-4f90-8c14-0fdffeadedcc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 210 time: 0.2392697 Dec 14 03:22:35.314788 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732bf706-be64-4f72-b6ce-85fbb5e42d67 req-41c39589-082b-427d-9ac4-3a5da3be87ef tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:35.316349 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-732bf706-be64-4f72-b6ce-85fbb5e42d67 req-41c39589-082b-427d-9ac4-3a5da3be87ef tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0497401 Dec 14 03:22:35.429832 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-732bf706-be64-4f72-b6ce-85fbb5e42d67 req-7ee8a0a0-06b9-4dcf-90f5-49b7ae8aea78 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037440 Dec 14 03:22:35.466711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-96e57d66-3b75-4433-8749-66a016b60bff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:35.468238 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-96e57d66-3b75-4433-8749-66a016b60bff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 810 time: 0.1510460 Dec 14 03:22:35.543145 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-a674c3da-d6da-413f-a395-38a1a8e3c308 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=11634c00674445cb81d9dabfbcc791a8 HTTP/1.1" status: 200 len: 379 time: 0.0549655 Dec 14 03:22:35.622902 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'port': {'device_id': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'admin_state_up': True, 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'security_groups': ['82422a55-c106-4735-9c53-08650620c7f6']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:35.727556 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Made reservation on behalf of 11634c00674445cb81d9dabfbcc791a8 for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:22:35.730964 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:35.853284 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Allocated IP 172.20.0.10 (7e397d2e-d5ba-40c3-8051-57991a288ab3/cc81a563-179d-4cba-977d-84ceacabb0ec/cf2ca0eb-9e28-4a89-8062-525c1792d08a) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:35.984586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.017375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.058967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:36.062069 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:36.065714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:36.090862 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event updated for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:36.133636 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:36.134254 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.176827 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-8eebfd91-0f53-4fb6-badc-2f085b5faf6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5598276 Dec 14 03:22:36.194026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d6195c-c969-4014-ab7e-1cf435a811cd req-b246d24d-9795-4b46-8595-8d51f1c05554 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:36.195633 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97d6195c-c969-4014-ab7e-1cf435a811cd req-b246d24d-9795-4b46-8595-8d51f1c05554 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 932 time: 0.0756774 Dec 14 03:22:36.200766 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Request body: {'port': {'device_id': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:36.286726 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.292982 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97d6195c-c969-4014-ab7e-1cf435a811cd req-a561eb25-4f1a-4916-afe6-2a44da448cd2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0884035 Dec 14 03:22:36.312452 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-75646baa-3d3c-44cc-84b2-46083d6c59db None None] Provisioning complete for port cf2ca0eb-9e28-4a89-8062-525c1792d08a triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:36.313352 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-75646baa-3d3c-44cc-84b2-46083d6c59db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.346898 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-75646baa-3d3c-44cc-84b2-46083d6c59db None None] Port cf2ca0eb-9e28-4a89-8062-525c1792d08a cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:22:36.588122 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf2ca0eb-9e28-4a89-8062-525c1792d08a {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:22:36.598854 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d7dab5-00c3-495f-af9b-6c572a4df71e req-4238df89-edb3-4078-aec3-9595ae61a47e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:36.600926 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53d7dab5-00c3-495f-af9b-6c572a4df71e req-4238df89-edb3-4078-aec3-9595ae61a47e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0915370 Dec 14 03:22:36.604914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.633923 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Transition to ACTIVE for port object cf2ca0eb-9e28-4a89-8062-525c1792d08a will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:22:36.639265 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.707996 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-53d7dab5-00c3-495f-af9b-6c572a4df71e req-1d039f6b-dc18-48fc-9295-8b9e99b0d38b tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/security-groups?id=c5aea58c-8de2-497c-802a-0d4e5575f808&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006572 Dec 14 03:22:36.715690 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Pushing event updated for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:36.810188 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Attempting to bind port cf2ca0eb-9e28-4a89-8062-525c1792d08a on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:36.810628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Attempting to bind port cf2ca0eb-9e28-4a89-8062-525c1792d08a by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:36.811084 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Attempting to bind port cf2ca0eb-9e28-4a89-8062-525c1792d08a on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:36.815939 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Port cf2ca0eb-9e28-4a89-8062-525c1792d08a on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:22:36.816493 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Attempting to bind port cf2ca0eb-9e28-4a89-8062-525c1792d08a on network 7e397d2e-d5ba-40c3-8051-57991a288ab3 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:36.823035 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:36.823544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Checking segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:36.824006 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Bound using segment: {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:36.824440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Bound port: cf2ca0eb-9e28-4a89-8062-525c1792d08a, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a99fd986-ad0c-461f-859e-1ffa364c753d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:36.824797 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.893189 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:36.896108 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:36.900921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.936445 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:36.937084 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:36.938500 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] 10.222.0.20 "PUT /v2.0/ports/cf2ca0eb-9e28-4a89-8062-525c1792d08a HTTP/1.1" status: 200 len: 1094 time: 0.7418849 Dec 14 03:22:36.938934 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:36.941145 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94dd2243-a278-4532-85c7-5b3ef12746b6" -d '{"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:36.975175 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e85df93-547d-46d6-b605-7e9765c85de2 service neutron] Pushing event updated for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:36.982959 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63a14555-64ce-4b29-b68e-3374bf6fdd3d x-openstack-request-id: req-63a14555-64ce-4b29-b68e-3374bf6fdd3d {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:36.983464 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:36.983898 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-63a14555-64ce-4b29-b68e-3374bf6fdd3d {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:36.984438 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'status': 'completed', 'code': 200} Dec 14 03:22:37.124941 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-5b24397e-65c5-4060-84d3-587bfb336d3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.127082 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-5b24397e-65c5-4060-84d3-587bfb336d3a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 1097 time: 0.0497985 Dec 14 03:22:37.129287 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-fb9e406f-bede-485d-9266-2412b3a4f7b7 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.130779 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-fb9e406f-bede-485d-9266-2412b3a4f7b7 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.20 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 946 time: 0.0537729 Dec 14 03:22:37.236821 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Deleting port bb3c28d2-c03d-4924-8dd8-da975e5427e4 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:37.237092 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:37.241657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-95acad8f-5451-4fd8-8e22-28e82431fb71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.243140 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-95acad8f-5451-4fd8-8e22-28e82431fb71 service neutron] 10.222.0.20 "GET /v2.0/networks?tenant_id=11634c00674445cb81d9dabfbcc791a8&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0957758 Dec 14 03:22:37.323213 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] For port bb3c28d2-c03d-4924-8dd8-da975e5427e4, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=bb3c28d2-c03d-4924-8dd8-da975e5427e4,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:37.323544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:37.336305 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling delete_port for bb3c28d2-c03d-4924-8dd8-da975e5427e4 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:37.338598 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-c7a4f7e3-a537-456b-876b-40af397986e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.340128 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-c7a4f7e3-a537-456b-876b-40af397986e3 service neutron] 10.222.0.20 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0901859 Dec 14 03:22:37.439016 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-006eb5de-978c-4a56-bbe5-7d236aafc421 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.440535 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-006eb5de-978c-4a56-bbe5-7d236aafc421 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 1097 time: 0.0397830 Dec 14 03:22:37.453020 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5adb09e5-0825-4ab8-b834-eae0221cdd98 req-3848c06f-b834-4eb2-add7-1e00f70ce71f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.454470 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5adb09e5-0825-4ab8-b834-eae0221cdd98 req-3848c06f-b834-4eb2-add7-1e00f70ce71f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 944 time: 0.0728822 Dec 14 03:22:37.494578 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-c862d306-db4d-48b0-9d67-e09c0da97824 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a HTTP/1.1" status: 200 len: 217 time: 0.0382066 Dec 14 03:22:37.544637 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5adb09e5-0825-4ab8-b834-eae0221cdd98 req-083917eb-3715-447f-ada5-c35ab2d64b39 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0834200 Dec 14 03:22:37.545197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-a65f0535-3921-435d-bac8-aad41bba25e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.545648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:37.546763 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-a65f0535-3921-435d-bac8-aad41bba25e0 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0437145 Dec 14 03:22:37.574457 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Pushing event deleted for resources: {'Port': ['ID=bb3c28d2-c03d-4924-8dd8-da975e5427e4,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:37.588664 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['bb3c28d2-c03d-4924-8dd8-da975e5427e4'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:37.595768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cca9534-332e-49c8-ba84-c603e38142bf req-e55db47c-7685-4357-b812-bfa33d8535ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:37.597420 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-e55db47c-7685-4357-b812-bfa33d8535ee service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434856 Dec 14 03:22:37.614794 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] No DVR routers for this DVR port bb3c28d2-c03d-4924-8dd8-da975e5427e4 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:37.617845 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:37.621299 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-176be8fd-22fd-455b-ba43-cd6f10829988 req-655b72a0-732e-4110-8081-b97d4c96f126 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.20 "DELETE /v2.0/ports/bb3c28d2-c03d-4924-8dd8-da975e5427e4 HTTP/1.1" status: 204 len: 173 time: 0.4729741 Dec 14 03:22:37.694893 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-3070ad40-a86b-4db5-9df7-24ab50246dad service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883439 Dec 14 03:22:37.790787 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-0cca9534-332e-49c8-ba84-c603e38142bf req-bc83d6bd-cbc9-4da8-aee1-f450754d5e89 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838964 Dec 14 03:22:37.837117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc req-d45dc410-a39f-48c6-bffd-86859065caf6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /v2.0/ports?device_id=cfd2456c-8f28-4be0-9c97-8e03b0fec041 HTTP/1.1" status: 200 len: 210 time: 0.0336533 Dec 14 03:22:38.678206 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c802f17-faff-498a-9ed3-50a9cad6ecdf req-62d1add9-f259-4b90-b162-c51ed876fdae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:38.679865 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c802f17-faff-498a-9ed3-50a9cad6ecdf req-62d1add9-f259-4b90-b162-c51ed876fdae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 944 time: 0.0544913 Dec 14 03:22:38.729372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0c802f17-faff-498a-9ed3-50a9cad6ecdf req-4fb7e4fc-8663-445c-aa2a-22cc1b9f9b25 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430510 Dec 14 03:22:38.986217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'name': 'network-vif-deleted', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:38.990672 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac" -d '{"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-deleted", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:39.028285 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f535c57-ef56-494b-971f-0eefcd49205c x-openstack-request-id: req-2f535c57-ef56-494b-971f-0eefcd49205c {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:39.028576 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-deleted", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:39.028829 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2f535c57-ef56-494b-971f-0eefcd49205c {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:39.029216 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cfd2456c-8f28-4be0-9c97-8e03b0fec041', 'name': 'network-vif-deleted', 'tag': 'bb3c28d2-c03d-4924-8dd8-da975e5427e4', 'status': 'completed', 'code': 200} Dec 14 03:22:39.565814 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56512) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:39.848954 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8805c4ed-cacc-42ec-8368-76473a873cae req-43307a8a-730c-447c-b0e7-6b3fa62548f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:39.850529 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8805c4ed-cacc-42ec-8368-76473a873cae req-43307a8a-730c-447c-b0e7-6b3fa62548f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 944 time: 0.0498848 Dec 14 03:22:39.900095 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8805c4ed-cacc-42ec-8368-76473a873cae req-db96596f-7b1f-413f-8c03-1cb12b4c6444 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434327 Dec 14 03:22:40.267409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:40.492700 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device bb3c28d2-c03d-4924-8dd8-da975e5427e4 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:40.507651 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Deleting port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:40.507992 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:40.513999 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: bb3c28d2-c03d-4924-8dd8-da975e5427e4 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:40.514342 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device bb3c28d2-c03d-4924-8dd8-da975e5427e4 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:40.584640 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] For port 1f1825d8-5cf4-485e-a2c8-2412e7b8f483, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:40.585165 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:40.596202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Calling delete_port for 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 owned by network:router_interface {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:40.770212 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:40.797875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Pushing event deleted for resources: {'Port': ['ID=1f1825d8-5cf4-485e-a2c8-2412e7b8f483,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:40.956743 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.018059 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3596d39-46ae-4128-a054-a1d28d8e2a9b req-71d52c3c-81bb-4b61-b2c8-e951fc42e640 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:41.019530 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3596d39-46ae-4128-a054-a1d28d8e2a9b req-71d52c3c-81bb-4b61-b2c8-e951fc42e640 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 944 time: 0.0468838 Dec 14 03:22:41.069522 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3596d39-46ae-4128-a054-a1d28d8e2a9b req-e62eaea7-7aa7-499e-82d6-509b4e3828ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432630 Dec 14 03:22:41.164815 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:41.263483 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.270345 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:41.277100 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-121cdbbb-8b22-4b1b-bdaf-321813f8f6bf admin admin] 10.222.0.43 "PUT /v2.0/routers/5c4f5fd8-fa7e-4996-8795-402edb6c7a72/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7102027 Dec 14 03:22:41.280040 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56536) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:41.280408 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Sync routers for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:41.291305 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:41.291952 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:41.401402 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks [] for router, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.405342 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:41.499234 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.556225 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Deleting port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:41.556755 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.578069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150'}], 'enable_snat': True}, 'gw_port_id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:22:40Z', 'revision_number': 5, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port': {'id': '3791fc7e-d6a0-4f44-ab90-7ba8b8a19100', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b4:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:43Z', 'updated_at': '2021-12-14T03:16:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:41.603799 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Checking router: 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:41.612302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Routers {'5c4f5fd8-fa7e-4996-8795-402edb6c7a72'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:41.613180 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:41.638983 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] For port 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:41.639407 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.650765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Calling delete_port for 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 owned by network:router_gateway {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:41.696605 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] Set router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 gateway port host: None {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:41.748979 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:22:41Z', 'revision_number': 6, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:41.775222 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b27672bf-0c37-4148-a4ae-d1781727bded None None] The sync data for ids ['5c4f5fd8-fa7e-4996-8795-402edb6c7a72'] in dv-cinder-818037-8-iscsi is: [{'id': '5c4f5fd8-fa7e-4996-8795-402edb6c7a72', 'name': 'tempest-TestMinimumBasicScenario-465714400-router', 'tenant_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:42Z', 'updated_at': '2021-12-14T03:22:41Z', 'revision_number': 6, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'gw_port_host': None}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:41.812404 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.837679 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Pushing event deleted for resources: {'Port': ['ID=3791fc7e-d6a0-4f44-ab90-7ba8b8a19100,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:41.898950 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:41.998217 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.000443 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.064751 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.065483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5c4f5fd8-fa7e-4996-8795-402edb6c7a72 {{(pid=102571) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:22:42.073075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.074188 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-70162e9a-ed97-4676-ac78-5d35091aa231 admin admin] 10.222.0.43 "DELETE /v2.0/routers/5c4f5fd8-fa7e-4996-8795-402edb6c7a72 HTTP/1.1" status: 204 len: 168 time: 0.7923548 Dec 14 03:22:42.076628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56540) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:42.121870 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Deleting subnet 4b4783ac-1363-4237-9ce6-75efb61eaefb {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:22:42.125331 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.161462 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.288891 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.371443 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77736caf-6760-4773-829e-c6ba57df4d4c req-c9ff830c-8322-4f56-9df5-eda0306c0185 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:42.372926 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77736caf-6760-4773-829e-c6ba57df4d4c req-c9ff830c-8322-4f56-9df5-eda0306c0185 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 944 time: 0.0646980 Dec 14 03:22:42.386411 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.431453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b4783ac-1363-4237-9ce6-75efb61eaefb,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:42.433695 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.439455 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-201cfec5-1d13-4a4e-b887-5ce7c7f0d862 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/4b4783ac-1363-4237-9ce6-75efb61eaefb HTTP/1.1" status: 204 len: 168 time: 0.3618667 Dec 14 03:22:42.439707 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56556) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:42.440155 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02153aa7-9ca7-47d8-aac7-9af35f3d8be6 None None] Network f2ccc364-1044-4d86-92a1-159741b0fffd requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:42.469154 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-77736caf-6760-4773-829e-c6ba57df4d4c req-d9b9bd83-4c27-405c-bc50-44ab9f5a9718 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0891287 Dec 14 03:22:42.514490 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device cf2ca0eb-9e28-4a89-8062-525c1792d08a details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:22:42.525799 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.586105 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Deleting port 325a5471-9faf-4abb-b7be-4f4f49d2b904 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:42.586687 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.663468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] For port 325a5471-9faf-4abb-b7be-4f4f49d2b904, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=325a5471-9faf-4abb-b7be-4f4f49d2b904,segment=NetworkSegment(c0cd6eb9-f6bc-4666-858b-bca42d1674d0),segment_id=c0cd6eb9-f6bc-4666-858b-bca42d1674d0)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:42.663672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.679684 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Calling delete_port for 325a5471-9faf-4abb-b7be-4f4f49d2b904 owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:42.766992 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:42.772112 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.794470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:42.794823 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 3791fc7e-d6a0-4f44-ab90-7ba8b8a19100 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:42.795262 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:42.801539 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=325a5471-9faf-4abb-b7be-4f4f49d2b904,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:42.804090 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] No DVR routers for this DVR port 325a5471-9faf-4abb-b7be-4f4f49d2b904 on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:42.837729 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:42.838137 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 1f1825d8-5cf4-485e-a2c8-2412e7b8f483 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:42.840638 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:42.853941 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'port_id': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'mac_address': 'fa:16:3e:e6:0e:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 263, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:22:42.884225 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.905112 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.917194 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2ccc364-1044-4d86-92a1-159741b0fffd']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:42.924493 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e1c1d5a-f846-4579-be45-a84d5a285da0 None None] DHCP port deletion for f2ccc364-1044-4d86-92a1-159741b0fffd request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:22:42.928547 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:42.928917 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c0cd6eb9-f6bc-4666-858b-bca42d1674d0') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:42.932171 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf2ca0eb-9e28-4a89-8062-525c1792d08a {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:22:42.938559 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.953072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.959936 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Releasing vlan 251 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:22:42.960337 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:22:42.962215 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:22:42.966701 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:42.971387 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:43.019737 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:43.024209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:43.029330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:43.032523 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] 10.222.0.43 "DELETE /v2.0/networks/f2ccc364-1044-4d86-92a1-159741b0fffd HTTP/1.1" status: 204 len: 168 time: 0.5920410 Dec 14 03:22:43.035660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56568) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:43.043753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcad0d37-a95e-4436-b831-3a6e1ae582c5 admin admin] Pushing event deleted for resources: {'Network': ['ID=f2ccc364-1044-4d86-92a1-159741b0fffd,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:43.364535 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['cf2ca0eb-9e28-4a89-8062-525c1792d08a'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:22:43.619574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e28bf7-44f1-41f8-985f-8e645fbd3282 req-40a40e44-032d-4572-a7ce-aee102880208 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:43.620932 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69e28bf7-44f1-41f8-985f-8e645fbd3282 req-40a40e44-032d-4572-a7ce-aee102880208 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 945 time: 0.0791118 Dec 14 03:22:43.718504 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-69e28bf7-44f1-41f8-985f-8e645fbd3282 req-586d4208-cd75-409a-b77b-84b0c8bce23f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0890777 Dec 14 03:22:43.749424 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.033037 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Deleting port d126ebc8-c629-45a9-8fa9-12005408d041 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:44.033262 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.112991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] For port d126ebc8-c629-45a9-8fa9-12005408d041, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d126ebc8-c629-45a9-8fa9-12005408d041,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:44.113371 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.125086 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Calling delete_port for d126ebc8-c629-45a9-8fa9-12005408d041 owned by network:router_interface {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:44.297565 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.322936 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Pushing event deleted for resources: {'Port': ['ID=d126ebc8-c629-45a9-8fa9-12005408d041,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:44.484572 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.515306 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device cf2ca0eb-9e28-4a89-8062-525c1792d08a up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:44.569208 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port cf2ca0eb-9e28-4a89-8062-525c1792d08a completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:22:44.573162 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port cf2ca0eb-9e28-4a89-8062-525c1792d08a triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:44.573538 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.653274 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 325a5471-9faf-4abb-b7be-4f4f49d2b904 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:44.676044 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.678298 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 325a5471-9faf-4abb-b7be-4f4f49d2b904 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:44.678635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 325a5471-9faf-4abb-b7be-4f4f49d2b904 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:44.700955 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:44.701243 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Router 43a3da57-3840-4a67-8a18-1714364c5636 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:44.703194 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f" -d '{"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:44.716226 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:44.720917 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.769638 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c x-openstack-request-id: req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:44.769944 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:44.770206 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:44.770601 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'code': 200} Dec 14 03:22:44.776061 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:44.813415 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:44.820837 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-0b27b324-3fb8-4dc8-b191-65b578884275 admin admin] 10.222.0.43 "PUT /v2.0/routers/43a3da57-3840-4a67-8a18-1714364c5636/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7829416 Dec 14 03:22:44.823422 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56588) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:44.827719 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Sync routers for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:44.849173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56590) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:44.852343 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:44.853152 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:44.910460 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3880bd07-c439-420a-9412-ef794183e490 req-18cee153-e30e-45fd-85a3-2a2680a99276 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:44.912025 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3880bd07-c439-420a-9412-ef794183e490 req-18cee153-e30e-45fd-85a3-2a2680a99276 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0968091 Dec 14 03:22:44.924378 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Deleting subnet 9ff8b720-271a-4b6f-88c1-3bac5c3efbdc {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:22:44.934808 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.952912 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:44.989536 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:44.990699 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.032433 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3880bd07-c439-420a-9412-ef794183e490 req-77af0887-e6fb-42a4-9d61-102b95da84d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1041775 Dec 14 03:22:45.047738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.088620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b23205-8e44-429a-8eb2-533dae5abaac req-67b3bce6-1e05-4ef9-b938-55ec66b1efc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:45.090154 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6b23205-8e44-429a-8eb2-533dae5abaac req-67b3bce6-1e05-4ef9-b938-55ec66b1efc4 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 1099 time: 0.0821989 Dec 14 03:22:45.097719 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.107111 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.135222 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9ff8b720-271a-4b6f-88c1-3bac5c3efbdc,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:45.137315 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.142959 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7dae3eb7-0722-483a-b3a6-c5e65765c9cb admin admin] 10.222.0.43 "DELETE /v2.0/subnets/9ff8b720-271a-4b6f-88c1-3bac5c3efbdc HTTP/1.1" status: 204 len: 168 time: 0.2897096 Dec 14 03:22:45.143365 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56592) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:45.167235 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f6b23205-8e44-429a-8eb2-533dae5abaac req-4e738320-3d7a-4b2b-998a-dc3a2a405a4d service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0657980 Dec 14 03:22:45.184198 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Deleting port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:45.184537 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.195936 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5'}], 'enable_snat': True}, 'gw_port_id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:22:44Z', 'revision_number': 5, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port': {'id': 'c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:da:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43a3da57-3840-4a67-8a18-1714364c5636', 'device_owner': 'network:router_gateway', 'standard_attr_id': 346, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:16:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.211967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.222323 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Checking router: 43a3da57-3840-4a67-8a18-1714364c5636 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:45.231731 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Routers {'43a3da57-3840-4a67-8a18-1714364c5636'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:45.232335 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['43a3da57-3840-4a67-8a18-1714364c5636'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.267186 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] For port c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:45.267578 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.279002 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Calling delete_port for c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:45.292960 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.313423 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['72a1ba60-29fb-46d5-ae0c-f4c2277490a8']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.319861 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] Set router 43a3da57-3840-4a67-8a18-1714364c5636 gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:45.322627 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '291bfcba-705b-40e6-839b-25e1bec3a7fe') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.323390 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '291bfcba-705b-40e6-839b-25e1bec3a7fe') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.334824 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.351118 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.357388 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Releasing vlan 275 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:22:45.357930 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:22:45.359897 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:22:45.375324 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:22:45Z', 'revision_number': 6, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:45.402369 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e031c9f4-956c-4cf7-9974-142092cc8b43 None None] The sync data for ids ['43a3da57-3840-4a67-8a18-1714364c5636'] in dv-cinder-818037-8-iscsi is: [{'id': '43a3da57-3840-4a67-8a18-1714364c5636', 'name': 'tempest-TestMinimumBasicScenario-1736292880-router', 'tenant_id': '574a0ff076ae428999f919b34df1c6c8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:16:48Z', 'updated_at': '2021-12-14T03:22:45Z', 'revision_number': 6, 'project_id': '574a0ff076ae428999f919b34df1c6c8', 'gw_port_host': None}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:45.423065 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.428276 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.434007 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] 10.222.0.43 "DELETE /v2.0/networks/72a1ba60-29fb-46d5-ae0c-f4c2277490a8 HTTP/1.1" status: 204 len: 168 time: 0.2874627 Dec 14 03:22:45.454790 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ab5c26-4dfd-4b87-9bb6-00437f66f0dd admin admin] Pushing event deleted for resources: {'Network': ['ID=72a1ba60-29fb-46d5-ae0c-f4c2277490a8,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:45.470043 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.496427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Pushing event deleted for resources: {'Port': ['ID=c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:45.556229 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56596) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:45.560870 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.597825 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-50506cca-1902-4e57-8df8-c3928fc33f38 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=325c78a0c8574ce0bb38f768705a1181&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0403426 Dec 14 03:22:45.601334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56598) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:45.650403 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.650805 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.652927 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.672412 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.696716 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.697194 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 43a3da57-3840-4a67-8a18-1714364c5636 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:22:45.701999 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.705180 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ebb5638c-f3ff-4978-ac10-5acdd06eb816 admin admin] 10.222.0.43 "DELETE /v2.0/routers/43a3da57-3840-4a67-8a18-1714364c5636 HTTP/1.1" status: 204 len: 168 time: 0.8783159 Dec 14 03:22:45.705415 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56600) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:45.723456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.726674 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.727840 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/dec61bef-9218-413c-b74e-76a85a176263 HTTP/1.1" status: 204 len: 168 time: 0.1256726 Dec 14 03:22:45.742102 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f736669-fae3-4c72-9720-7954a49bb260 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dec61bef-9218-413c-b74e-76a85a176263,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:45.751147 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Deleting subnet 49905273-bd25-4b7d-ac4b-f22b00cfcd1a {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:22:45.754528 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.789775 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.914072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:45.969459 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.000341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=49905273-bd25-4b7d-ac4b-f22b00cfcd1a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:46.004363 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.010572 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-272bae5a-4c21-4195-8c6f-9ab2e92f19c3 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/49905273-bd25-4b7d-ac4b-f22b00cfcd1a HTTP/1.1" status: 204 len: 168 time: 0.3019021 Dec 14 03:22:46.010794 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56606) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:46.012306 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d259854-75a6-4dba-ba38-ebf4a6a5ee4c None None] Network fff3dc45-7393-4a44-8e77-f9ec683d1be8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:46.085157 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.138832 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Deleting port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:46.139304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.165484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 req-88c07f44-52bf-4a58-88d1-93c8be3078bb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:46.172993 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 req-88c07f44-52bf-4a58-88d1-93c8be3078bb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0557449 Dec 14 03:22:46.205098 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] DHCP port deletion for fff3dc45-7393-4a44-8e77-f9ec683d1be8 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:22:46.211504 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] For port fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:46.211865 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.225682 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Calling delete_port for fce16d5b-db9d-41c4-9b15-57f41b6e2de2 owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:46.227626 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 req-ae346001-8f5c-4b2e-827c-964d65a0c1ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537765 Dec 14 03:22:46.262032 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Deleting port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 {{(pid=102573) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:22:46.262514 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.316798 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.330433 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] For port fce16d5b-db9d-41c4-9b15-57f41b6e2de2, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,segment=NetworkSegment(43ae2319-fd15-465f-bef2-747b3e5bb2be),segment_id=43ae2319-fd15-465f-bef2-747b3e5bb2be)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:46.331231 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.344013 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Calling delete_port for fce16d5b-db9d-41c4-9b15-57f41b6e2de2 owned by network:dhcp {{(pid=102573) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:22:46.344575 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Pushing event deleted for resources: {'Port': ['ID=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:46.346661 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] No DVR routers for this DVR port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:46.422458 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.448311 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fff3dc45-7393-4a44-8e77-f9ec683d1be8']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:46.460733 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '43ae2319-fd15-465f-bef2-747b3e5bb2be') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:46.461304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '43ae2319-fd15-465f-bef2-747b3e5bb2be') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:46.472775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.475636 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.493942 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.499273 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Pushing event deleted for resources: {'Port': ['ID=fce16d5b-db9d-41c4-9b15-57f41b6e2de2,revision_number=None']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:46.502742 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Releasing vlan 281 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:22:46.503153 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:22:46.504806 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:22:46.507569 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] No DVR routers for this DVR port fce16d5b-db9d-41c4-9b15-57f41b6e2de2 on host dv-cinder-818037-8-iscsi {{(pid=102573) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:22:46.509726 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.510079 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.510431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.510833 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.511195 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.511532 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.511863 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.512196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.512527 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.512861 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.513196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.513518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.513847 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e246fce-fc19-47d3-987f-3c1147d1cdaf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:46.567477 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.573862 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.579696 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] 10.222.0.43 "DELETE /v2.0/networks/fff3dc45-7393-4a44-8e77-f9ec683d1be8 HTTP/1.1" status: 204 len: 168 time: 0.5653336 Dec 14 03:22:46.590044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159ac6a9-802c-4fe2-b92e-151a70b82fc1 admin admin] Pushing event deleted for resources: {'Network': ['ID=fff3dc45-7393-4a44-8e77-f9ec683d1be8,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:46.634809 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:46.654116 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:46.654463 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c8b6f5fc-33c1-47e8-b1d4-93cad8e9ef3c not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:46.655105 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d126ebc8-c629-45a9-8fa9-12005408d041 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:46.674674 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: d126ebc8-c629-45a9-8fa9-12005408d041 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:46.675011 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d126ebc8-c629-45a9-8fa9-12005408d041 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:46.675611 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fce16d5b-db9d-41c4-9b15-57f41b6e2de2 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:22:46.699458 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: fce16d5b-db9d-41c4-9b15-57f41b6e2de2 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:22:46.699840 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fce16d5b-db9d-41c4-9b15-57f41b6e2de2 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:22:46.757247 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56612) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:46.795408 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-92384eb6-befa-4d14-8679-178669048ef5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bc2e5ee76edf4e358f418773bf824ed7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0369945 Dec 14 03:22:46.797773 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56614) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:46.842992 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.864475 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.908037 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.910655 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:46.912389 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c5aea58c-8de2-497c-802a-0d4e5575f808 HTTP/1.1" status: 204 len: 168 time: 0.1132045 Dec 14 03:22:46.920190 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ad887b-3954-45c7-99bd-bb96a0e869f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5aea58c-8de2-497c-802a-0d4e5575f808,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:47.217759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56622) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:47.256687 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3498e879-f101-49be-829b-b7ddc45c1b07 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=574a0ff076ae428999f919b34df1c6c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0377517 Dec 14 03:22:47.259225 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56626) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:47.329126 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:47.356287 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:47.379360 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d req-789b9b93-1949-4d0c-a535-7d3c1078476f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:47.381351 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d req-789b9b93-1949-4d0c-a535-7d3c1078476f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0854537 Dec 14 03:22:47.439599 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d req-acffe1c1-4195-4630-9e0d-d66fdbe85d5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508671 Dec 14 03:22:47.440682 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:47.444013 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:47.445322 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/84ca51dc-aff0-40bf-aa79-0abdd5ed61b5 HTTP/1.1" status: 204 len: 168 time: 0.1851921 Dec 14 03:22:47.454141 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db9c4a0-34a3-4e19-961f-cc095eb86384 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84ca51dc-aff0-40bf-aa79-0abdd5ed61b5,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:47.559852 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 req-b34cb1aa-7c88-4237-b61c-1bf72c95e221 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:47.561332 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 req-b34cb1aa-7c88-4237-b61c-1bf72c95e221 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0486653 Dec 14 03:22:47.570850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56632) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:47.575949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Request body: {'floatingip': {'port_id': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:47.619232 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.160556 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56654) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:48.256738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1966875039-network', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:48.278126 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Made reservation on behalf of d0c4dcf4957d42b896f04f682afeef7b for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:22:48.280522 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.288843 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.330083 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.334063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.368692 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.373105 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.398288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 257} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:22:48.406967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb859d2b-ad0d-4c62-8e95-71a5aec1a0d3,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:48.412826 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.413234 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Added segment 8ad2a459-2b39-4ed4-958c-72bc8ba606a8 of type vlan for network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 Dec 14 03:22:48.438570 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Floating IP 06546c06-fc07-462f-b88d-cb1be5de718e associated. External IP: 172.27.3.30, port: cf2ca0eb-9e28-4a89-8062-525c1792d08a. Dec 14 03:22:48.452592 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.476735 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.477845 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:48.478461 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.534682 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3730197 Dec 14 03:22:48.538025 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56658) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:48.540061 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7e6527-7d98-40ae-a6a6-7d6e4bfec3b7 admin admin] Pushing event updated for resources: {'Network': ['ID=8f2d77d5-e58c-4a97-8899-5e1a2da29f69,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:48.543024 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Request body: {'subnet': {'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1966875039-subnet', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:48.550813 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:22:48.605241 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Made reservation on behalf of d0c4dcf4957d42b896f04f682afeef7b for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:22:48.607518 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8547576'] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.721258 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:48.894831 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12248346', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8547558'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.918889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:48.925557 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:48.929966 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:48.943310 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:48.944202 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:48.965044 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7ce6af7e-c385-4235-a5c7-1b8159bd3346 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "PUT /v2.0/floatingips/06546c06-fc07-462f-b88d-cb1be5de718e HTTP/1.1" status: 200 len: 991 time: 1.3930120 Dec 14 03:22:48.967319 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:22:48.969550 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56c0a8d9-7a70-469e-bd00-ae0a14df3993" -d '{"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:22:48.978889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:48.994647 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:48.995133 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Network hostable DHCP agents. Network: 8f2d77d5-e58c-4a97-8899-5e1a2da29f69, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:22:49.014603 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:22:49.025470 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 8f2d77d5-e58c-4a97-8899-5e1a2da29f69) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:49.029805 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:22:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-404d0df7-3b94-4116-9f64-5bc5c25602ee x-openstack-request-id: req-404d0df7-3b94-4116-9f64-5bc5c25602ee {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:22:49.030138 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:22:49.030439 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-404d0df7-3b94-4116-9f64-5bc5c25602ee {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:22:49.031285 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'status': 'completed', 'code': 200} Dec 14 03:22:49.033728 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:49.034320 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.035495 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a5a8b71-7c30-4aa7-9c4a-592d3662fe91 None None] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:49.052822 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3d78d775-d2e8-48e7-beeb-0cfd438aa4b4 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5127995 Dec 14 03:22:49.055585 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56664) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:49.059980 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:49.080594 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.081602 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.101095 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:49.123595 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-8a44948f-a476-454f-8935-b2ff1379903d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:49.125177 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-8a44948f-a476-454f-8935-b2ff1379903d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 1099 time: 0.0419700 Dec 14 03:22:49.149801 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.221327 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:22:49.223330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.228343 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-4c1518e3-701c-482a-b5c8-99bee59e7b95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:49.229809 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-4c1518e3-701c-482a-b5c8-99bee59e7b95 service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.0970013 Dec 14 03:22:49.289339 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.314815 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-f411f703-2757-4391-b546-4284780509d4 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a HTTP/1.1" status: 200 len: 999 time: 0.0754578 Dec 14 03:22:49.377624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-a5c216d7-e0cf-42ea-a6a7-c9871a195829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:49.379773 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-a5c216d7-e0cf-42ea-a6a7-c9871a195829 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0566564 Dec 14 03:22:49.429873 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-d3e36beb-4644-4ebe-a39a-80c144036863 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:49.431457 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-d3e36beb-4644-4ebe-a39a-80c144036863 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0446434 Dec 14 03:22:49.533106 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-f22af38e-07fc-43ea-9a0a-26ab113cf232 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919924 Dec 14 03:22:49.592091 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Allocated IP 172.20.0.2 (8f2d77d5-e58c-4a97-8899-5e1a2da29f69/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5/9cd18753-cb37-4507-b3f5-aae0e77d97a7) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:49.634522 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-7d8b4626-3864-4af5-baa3-e3ad12a3aa26 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940003 Dec 14 03:22:49.700211 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-365c10a5-319e-4e0b-a5ef-98549f141db1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.702733 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '06546c06-fc07-462f-b88d-cb1be5de718e', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.30', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:e6:0e:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:22:32Z', 'updated_at': '2021-12-14T03:22:48Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:49.729542 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.740002 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:49.748123 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.774857 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:49.775530 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:49.853867 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Allocated IP 172.27.3.53 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/9186ead8-43ee-4172-ae38-64359eb23762) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:49.854113 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.860347 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.933764 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:49.939964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:49.948715 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:49.954326 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:49.957834 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:49.982064 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Pushing event updated for resources: {'Port': ['ID=9cd18753-cb37-4507-b3f5-aae0e77d97a7,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:49.991522 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.032776 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:50.035863 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:50.039422 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:50.064174 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Pushing event updated for resources: {'Port': ['ID=9186ead8-43ee-4172-ae38-64359eb23762,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:50.081326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Attempting to bind port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:50.081695 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Attempting to bind port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:50.082061 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Attempting to bind port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:50.092116 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:50.092481 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:50.092874 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.093260 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Bound using segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:50.093718 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Bound port: 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:50.094213 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.214002 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] For port 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:50.235701 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] For port 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9cd18753-cb37-4507-b3f5-aae0e77d97a7,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:50.241385 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.285649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.330722 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2f3c31-5bbe-4a30-936d-0e185fe7c21a None None] Pushing event updated for resources: {'Port': ['ID=9cd18753-cb37-4507-b3f5-aae0e77d97a7,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:50.337776 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '06546c06-fc07-462f-b88d-cb1be5de718e', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.30', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:e6:0e:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:22:32Z', 'updated_at': '2021-12-14T03:22:48Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:50.372536 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b3735e7-4a84-4c88-8373-4fec87503972 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '06546c06-fc07-462f-b88d-cb1be5de718e', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'floating_ip_address': '172.27.3.30', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'port_id': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'mac_address': 'fa:16:3e:e6:0e:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:22:32Z', 'updated_at': '2021-12-14T03:22:48Z', 'revision_number': 1, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:50.495302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.634536 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba230980-d9ac-4917-a042-b44a5dee5b4f None None] New status for floating IP 06546c06-fc07-462f-b88d-cb1be5de718e: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:22:50.674632 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102571) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:22:50.679336 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9cd18753-cb37-4507-b3f5-aae0e77d97a7 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:50.735348 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:50.735630 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.782740 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:50.801661 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.802587 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:50.803326 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-804c3f8c-e003-4347-b78a-fed76779151e admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.7467055 Dec 14 03:22:50.805931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56672) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:50.834365 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:50.835020 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:50.837480 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.914202 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9cd18753-cb37-4507-b3f5-aae0e77d97a7,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:50.948716 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:50.996008 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:51.071015 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=9cd18753-cb37-4507-b3f5-aae0e77d97a7,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:51.197042 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:50Z', 'revision_number': 3, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:51.229790 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:51.230077 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Updating router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 port 9186ead8-43ee-4172-ae38-64359eb23762 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:22:51.231248 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.257732 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.387297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-441f710d-5f68-439c-8a1d-1accc1889069 None None] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:51.399324 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Allocated IP 172.20.0.1 (8f2d77d5-e58c-4a97-8899-5e1a2da29f69/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5/49cdd42c-ecfc-4c8b-b86c-377c97e3f097) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:51.505798 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.540485 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.583999 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:51.586917 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:51.590374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:51.595909 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Pushing event updated for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:51.629390 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-50cf8dc2-f2fa-4e5b-8de9-07051c328924 None None] Provisioning complete for port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:51.629692 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-50cf8dc2-f2fa-4e5b-8de9-07051c328924 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.633706 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.760933 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.828609 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.837307 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.906353 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-58f4d55c-e8b7-4be7-9e58-e0b3caac1081 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.909082 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6e3805-7bce-4d59-8d0d-ca6b4cc818ec None None] Pushing event updated for resources: {'Port': ['ID=9186ead8-43ee-4172-ae38-64359eb23762,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:51.912898 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Attempting to bind port 9186ead8-43ee-4172-ae38-64359eb23762 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:51.913265 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Attempting to bind port 9186ead8-43ee-4172-ae38-64359eb23762 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:51.913629 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Attempting to bind port 9186ead8-43ee-4172-ae38-64359eb23762 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:51.919667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:51.920092 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:51.920488 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.920893 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:51.921367 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Bound port: 9186ead8-43ee-4172-ae38-64359eb23762, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:51.921754 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.945811 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.951240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:51.979352 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] For port 9186ead8-43ee-4172-ae38-64359eb23762, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:51.982518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] For port 9186ead8-43ee-4172-ae38-64359eb23762, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9186ead8-43ee-4172-ae38-64359eb23762,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:51.989085 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.023418 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.025809 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Pushing event updated for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:52.061526 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:52.062166 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:52.096518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6e3805-7bce-4d59-8d0d-ca6b4cc818ec None None] Pushing event updated for resources: {'Port': ['ID=9186ead8-43ee-4172-ae38-64359eb23762,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:52.126461 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-0b183f6a-01ec-432e-b767-5439c8dcdd1c None None] Provisioning complete for port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:52.126839 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0b183f6a-01ec-432e-b767-5439c8dcdd1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.131083 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:52.132734 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:52.218170 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:52.269164 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:52.385356 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:52.389605 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-0b183f6a-01ec-432e-b767-5439c8dcdd1c None None] Provisioning complete for port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:52.389976 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0b183f6a-01ec-432e-b767-5439c8dcdd1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.391195 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3a0a4409-5e06-4993-b629-d396703b96bb admin admin] 10.222.0.43 "PUT /v2.0/routers/2c2f1865-1495-422f-ac78-ab2defb6e9f3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5839672 Dec 14 03:22:52.455631 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-0b183f6a-01ec-432e-b767-5439c8dcdd1c None None] Port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:22:52.482836 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 2, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:52.513055 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc783692-b9ea-4a19-a499-f49112334dd6 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 2, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:52.576210 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c0a25d15-71ff-4bb5-a152-654a942c6cb6 None None] Provisioning complete for port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:52.576705 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c0a25d15-71ff-4bb5-a152-654a942c6cb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.621864 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-c0a25d15-71ff-4bb5-a152-654a942c6cb6 None None] Port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:22:52.640544 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9cd18753-cb37-4507-b3f5-aae0e77d97a7 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:52.704716 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:52.705204 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.952180 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56696) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:52.957047 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1374087834-network', 'tenant_id': '0474e738524046fc9da3b998a6133a0d'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:52.978186 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Made reservation on behalf of 0474e738524046fc9da3b998a6133a0d for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:22:52.980940 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:52.991138 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.069543 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.073702 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.098262 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 270} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:22:53.107123 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8293b28b-ad3f-4ef2-8c68-89542a0641a3,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:53.113598 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.113938 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Added segment b56c903f-07fa-4dc1-91de-97262a061639 of type vlan for network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 Dec 14 03:22:53.155360 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.191580 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.193489 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:53.194146 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.250158 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.2944117 Dec 14 03:22:53.250460 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56698) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:53.256032 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Request body: {'subnet': {'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1374087834-subnet', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:53.261068 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6762b31f-1a5c-4adc-b059-3d7423c8a2d0 admin admin] Pushing event updated for resources: {'Network': ['ID=0d0ab0fa-c270-4b02-af87-b2dad39d1991,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:53.273223 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:22:53.284300 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Made reservation on behalf of 0474e738524046fc9da3b998a6133a0d for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:22:53.287718 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8547576'] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.467361 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12248346', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8547558'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.527174 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=4afceb57-1177-42c8-a230-784269818f59,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:53.537753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Checking segment: {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:53.538049 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Network hostable DHCP agents. Network: 0d0ab0fa-c270-4b02-af87-b2dad39d1991, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:22:53.555802 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:22:53.564937 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 0d0ab0fa-c270-4b02-af87-b2dad39d1991) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:53.569147 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:22:53.569722 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.577433 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-412e3cd3-58f3-42ce-b86e-431e639fc2de None None] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:53.591292 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-35c612b7-3c14-48af-a9c1-48d41f4798fc admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3391173 Dec 14 03:22:53.593689 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56702) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:53.600256 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:53.626793 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.628078 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.650777 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.698561 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.704974 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'project_id': '0474e738524046fc9da3b998a6133a0d', 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:22:53.706004 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.849358 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.851357 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Allocated IP 172.20.0.2 (0d0ab0fa-c270-4b02-af87-b2dad39d1991/4afceb57-1177-42c8-a230-784269818f59/09b5316e-21ba-4c13-b4bf-25a383c67c90) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:53.992722 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:53.998447 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.041965 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:54.046329 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:54.050819 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:54.053602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Pushing event updated for resources: {'Port': ['ID=09b5316e-21ba-4c13-b4bf-25a383c67c90,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:54.061922 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.081239 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.105262 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Attempting to bind port 09b5316e-21ba-4c13-b4bf-25a383c67c90 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:54.105629 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Attempting to bind port 09b5316e-21ba-4c13-b4bf-25a383c67c90 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:54.105986 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Attempting to bind port 09b5316e-21ba-4c13-b4bf-25a383c67c90 on network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:54.110878 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:54.111284 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Checking segment: {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:54.111680 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.112067 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Bound using segment: {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:54.112790 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Bound port: 09b5316e-21ba-4c13-b4bf-25a383c67c90, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:54.113166 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.175465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] For port 09b5316e-21ba-4c13-b4bf-25a383c67c90, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:54.179394 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] For port 09b5316e-21ba-4c13-b4bf-25a383c67c90, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=09b5316e-21ba-4c13-b4bf-25a383c67c90,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:54.183641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.184737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Allocated IP 172.27.3.231 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/59a5ed28-73fb-4b13-8800-72cd70183ae8) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:54.250217 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dcd3e18-dea3-4e1c-841c-c18dd5a572c5 None None] Pushing event updated for resources: {'Port': ['ID=09b5316e-21ba-4c13-b4bf-25a383c67c90,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:54.298226 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.332826 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.376340 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:54.379406 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:54.384527 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:54.405035 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Pushing event updated for resources: {'Port': ['ID=59a5ed28-73fb-4b13-8800-72cd70183ae8,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:54.598955 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:54.608993 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:54.609615 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:54.631729 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.689100 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.720157 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9186ead8-43ee-4172-ae38-64359eb23762 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:54.738739 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:54.790338 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 9186ead8-43ee-4172-ae38-64359eb23762 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:54.790853 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.888534 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.902058 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.915331 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 9186ead8-43ee-4172-ae38-64359eb23762, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9186ead8-43ee-4172-ae38-64359eb23762,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:54.922775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:54.923723 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 09b5316e-21ba-4c13-b4bf-25a383c67c90 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:54.953353 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 2, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:54.982614 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:54.983475 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Updating router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:22:55.014135 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=9186ead8-43ee-4172-ae38-64359eb23762,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:55.035959 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 09b5316e-21ba-4c13-b4bf-25a383c67c90 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:55.036882 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.062807 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Router e8b1674d-7093-437b-9aab-b62e35641c46 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102572) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:22:55.119643 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.132558 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.170326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 09b5316e-21ba-4c13-b4bf-25a383c67c90, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=09b5316e-21ba-4c13-b4bf-25a383c67c90,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:55.175953 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.182259 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:55.201644 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.203095 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-743221bf-3091-4ac6-a36e-8a8b2ba65c6c admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.6082287 Dec 14 03:22:55.205643 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56710) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:55.233966 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=09b5316e-21ba-4c13-b4bf-25a383c67c90,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:55.237196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Sync routers for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:22:55.248724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:55.249535 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:55.418822 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.425360 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.475525 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Pushing event updated for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:55.483987 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.484362 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.484728 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.485072 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.485408 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.485743 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.486074 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.486411 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.486741 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.488206 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.489277 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.489946 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.490290 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:55.490711 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6b8b6a4-2c4f-4833-9467-8b77702ed12f None None] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:22:55.564554 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Attempting to bind port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:55.565736 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Attempting to bind port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:55.566107 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Attempting to bind port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:55.573065 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:55.574164 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:55.574737 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.575832 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Bound using segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:55.576483 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Bound port: 49cdd42c-ecfc-4c8b-b86c-377c97e3f097, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:55.577625 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.579332 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:55.616550 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-421c2e6b-31b0-4ca7-a456-ccdf3286a8de None None] Provisioning complete for port 09b5316e-21ba-4c13-b4bf-25a383c67c90 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:55.616925 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-421c2e6b-31b0-4ca7-a456-ccdf3286a8de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.664280 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] For port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:55.670603 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] For port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:55.679551 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.745887 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:55.746779 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:55.810667 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7724ce3-6ec1-4755-8f1e-d9cdef09aaeb None None] Pushing event updated for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:55.879744 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:55.916342 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:55.967205 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 3, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:55.996870 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Checking router: e8b1674d-7093-437b-9aab-b62e35641c46 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:22:55.997391 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Updating router e8b1674d-7093-437b-9aab-b62e35641c46 port 59a5ed28-73fb-4b13-8800-72cd70183ae8 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:22:56.031617 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.056355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.105290 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] Provisioning complete for port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:56.105800 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.180089 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:55Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:56.210368 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfbac472-26d6-47e5-8743-8d46ef69b09d None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:55Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:56.262656 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Allocated IP 172.20.0.1 (0d0ab0fa-c270-4b02-af87-b2dad39d1991/4afceb57-1177-42c8-a230-784269818f59/62872077-63d5-45d1-b37c-b0b0d440965c) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:22:56.313424 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.377331 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.387542 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] For port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:22:56.394043 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.423780 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.442838 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.457282 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.465027 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4657efb-29d5-47a4-b74f-cf522ce88cfe None None] Pushing event updated for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:56.468218 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:56.471033 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:56.475637 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:22:56.498979 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Pushing event updated for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:56.518186 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.520952 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Attempting to bind port 59a5ed28-73fb-4b13-8800-72cd70183ae8 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:22:56.521321 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Attempting to bind port 59a5ed28-73fb-4b13-8800-72cd70183ae8 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:22:56.521682 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Attempting to bind port 59a5ed28-73fb-4b13-8800-72cd70183ae8 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:22:56.530891 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee30fe7-f686-484b-a346-daba0e2c89fa None None] Pushing event updated for resources: {'Port': ['ID=59a5ed28-73fb-4b13-8800-72cd70183ae8,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:56.535781 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:22:56.536717 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:22:56.537105 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.537494 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:22:56.537978 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Bound port: 59a5ed28-73fb-4b13-8800-72cd70183ae8, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:22:56.538355 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.542556 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c3450a8b-dea7-4f65-9153-e449727d5bf7 None None] Provisioning complete for port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:56.542918 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c3450a8b-dea7-4f65-9153-e449727d5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.652344 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] For port 59a5ed28-73fb-4b13-8800-72cd70183ae8, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:22:56.694949 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] For port 59a5ed28-73fb-4b13-8800-72cd70183ae8, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=59a5ed28-73fb-4b13-8800-72cd70183ae8,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:22:56.706474 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.726950 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.755479 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:56.817311 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c3450a8b-dea7-4f65-9153-e449727d5bf7 None None] Provisioning complete for port 09b5316e-21ba-4c13-b4bf-25a383c67c90 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:56.817692 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c3450a8b-dea7-4f65-9153-e449727d5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.871094 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee30fe7-f686-484b-a346-daba0e2c89fa None None] Pushing event updated for resources: {'Port': ['ID=59a5ed28-73fb-4b13-8800-72cd70183ae8,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:56.882210 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:22:56.882871 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:56.931650 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.937258 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:56.985629 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:56.985998 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.008319 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Pushing event updated for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:57.013388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.047806 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:22:57.104137 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:22:57.105866 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:22:57.243420 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Router e8b1674d-7093-437b-9aab-b62e35641c46 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:22:57.357250 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9186ead8-43ee-4172-ae38-64359eb23762 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:57.357620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:22:57.362866 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-94e15524-6ae2-4d3f-a10f-200ebc9f2201 admin admin] 10.222.0.43 "PUT /v2.0/routers/e8b1674d-7093-437b-9aab-b62e35641c46/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1556766 Dec 14 03:22:57.389541 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-be397d6d-22d9-48e2-9bae-65eda527d362 None None] Provisioning complete for port 62872077-63d5-45d1-b37c-b0b0d440965c triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:57.389848 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-be397d6d-22d9-48e2-9bae-65eda527d362 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.456863 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-be397d6d-22d9-48e2-9bae-65eda527d362 None None] Port 62872077-63d5-45d1-b37c-b0b0d440965c cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:22:57.495939 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 9186ead8-43ee-4172-ae38-64359eb23762 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:57.496333 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.545348 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '62872077-63d5-45d1-b37c-b0b0d440965c', 'name': '', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'mac_address': 'fa:16:3e:11:e5:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:56Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 1, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'subnets': [{'id': '4afceb57-1177-42c8-a230-784269818f59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:22:57.574253 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c60e37-16a4-42cf-a608-c9640fb20344 None None] The sync data for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi is: [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '62872077-63d5-45d1-b37c-b0b0d440965c', 'name': '', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'mac_address': 'fa:16:3e:11:e5:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:56Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 1, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'subnets': [{'id': '4afceb57-1177-42c8-a230-784269818f59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:22:57.617557 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-5a6fdcf6-d5c3-4aa6-a921-9aacc36e5df1 None None] Provisioning complete for port 62872077-63d5-45d1-b37c-b0b0d440965c triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:57.617933 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5a6fdcf6-d5c3-4aa6-a921-9aacc36e5df1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.651700 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 09b5316e-21ba-4c13-b4bf-25a383c67c90 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:22:57.688993 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-5a6fdcf6-d5c3-4aa6-a921-9aacc36e5df1 None None] Port 62872077-63d5-45d1-b37c-b0b0d440965c cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:22:57.711537 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 09b5316e-21ba-4c13-b4bf-25a383c67c90 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:22:57.711919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.891842 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56726) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:57.897117 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-201763541', 'description': 'tempest-secgroup-smoke-201763541 description', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:57.926228 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:57.997486 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.003162 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.033305 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.034550 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1416140 Dec 14 03:22:58.038037 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56730) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.043396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.049217 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b638089-7ae4-47cd-b28b-08cfd90b4d80 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa81265e-19a7-4c76-ae75-2b53568fe438,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.074400 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.133159 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.138309 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.154085 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=461811f2-17d5-4e1b-b767-d3a0f5990653,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.167438 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.168643 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3bf8d526-09ac-408f-845f-52b346e835aa tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1296663 Dec 14 03:22:58.171490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 56732) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.176161 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.203765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.263359 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.267302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.287782 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ecf74cc-85aa-4b0a-ad01-17150702a25d,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.295844 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.296202 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.296556 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.296901 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.297241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.297576 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.297910 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.298244 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.298577 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.298911 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.299266 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.299592 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.299918 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:22:58.304240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.307953 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-23668482-b7cc-40a1-a96e-f8283adbfb5c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1328814 Dec 14 03:22:58.308272 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56736) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.312764 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.337785 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.397192 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.400721 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.418492 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=da239e28-4d80-4984-9596-10c8f14f4d35,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.423005 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.424180 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-b7cf596c-199e-4ddf-9d13-0c8840d942f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1149178 Dec 14 03:22:58.427018 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56738) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.431264 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.456212 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.511879 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.515297 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.533240 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d53e709-6ba9-42e2-8daf-eaca811c8f37,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.539266 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.540435 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-17f14310-6006-4a18-b517-d145065f2c9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1124141 Dec 14 03:22:58.543193 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56740) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.547699 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.569187 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.securitygroups_db [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Project d0c4dcf4957d42b896f04f682afeef7b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:22:58.574052 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.630938 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.634509 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.652372 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=70cf5e27-b0a8-4734-9478-6d461261f92e,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.660605 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.662280 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8a8c481b-ba77-4d5d-acea-b546a922c003 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1181800 Dec 14 03:22:58.665026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 56742) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:22:58.669347 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'security_group_rule': {'security_group_id': 'aa81265e-19a7-4c76-ae75-2b53568fe438', 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:22:58.691228 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.securitygroups_db [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Project d0c4dcf4957d42b896f04f682afeef7b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:22:58.695956 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.754649 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.757876 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.774034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0af86b3a-afb7-4c31-8cd7-9f3a839796bc,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:22:58.782971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:22:58.784186 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-207c96c5-9ee8-412b-9a9f-4bb0a76ace4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1182365 Dec 14 03:23:00.634305 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 59a5ed28-73fb-4b13-8800-72cd70183ae8 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:23:00.681185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 59a5ed28-73fb-4b13-8800-72cd70183ae8 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:00.681557 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:00.721514 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Sync routers for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:23:00.731326 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:23:00.731930 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:00.764515 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:00.783741 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port 59a5ed28-73fb-4b13-8800-72cd70183ae8, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=59a5ed28-73fb-4b13-8800-72cd70183ae8,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:00.789248 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:00.839957 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=59a5ed28-73fb-4b13-8800-72cd70183ae8,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:00.840208 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:23:00.996513 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:23:01.057942 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '62872077-63d5-45d1-b37c-b0b0d440965c', 'name': '', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'mac_address': 'fa:16:3e:11:e5:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:56Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 2, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'subnets': [{'id': '4afceb57-1177-42c8-a230-784269818f59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:01.085923 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Checking router: e8b1674d-7093-437b-9aab-b62e35641c46 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:23:01.086277 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Updating router e8b1674d-7093-437b-9aab-b62e35641c46 port 62872077-63d5-45d1-b37c-b0b0d440965c binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:23:01.110031 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.371771 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.376419 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.426153 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187d0a04-3913-44a3-b4f5-1298bfc7e745 None None] Pushing event updated for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:01.472642 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Attempting to bind port 62872077-63d5-45d1-b37c-b0b0d440965c on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:23:01.473014 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Attempting to bind port 62872077-63d5-45d1-b37c-b0b0d440965c by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:23:01.473410 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Attempting to bind port 62872077-63d5-45d1-b37c-b0b0d440965c on network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:23:01.478608 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 22, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:23:01.478964 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Checking segment: {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:23:01.479390 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.479778 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Bound using segment: {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:23:01.480244 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Bound port: 62872077-63d5-45d1-b37c-b0b0d440965c, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b56c903f-07fa-4dc1-91de-97262a061639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 270, 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:23:01.480639 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.547471 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] For port 62872077-63d5-45d1-b37c-b0b0d440965c, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:23:01.554410 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] For port 62872077-63d5-45d1-b37c-b0b0d440965c, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=62872077-63d5-45d1-b37c-b0b0d440965c,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:23:01.560445 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.618166 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:23:01.618901 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:22:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:01.621747 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187d0a04-3913-44a3-b4f5-1298bfc7e745 None None] Pushing event updated for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:01.639901 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] Provisioning complete for port 62872077-63d5-45d1-b37c-b0b0d440965c triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:01.640383 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.755904 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.795523 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] For port 62872077-63d5-45d1-b37c-b0b0d440965c, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=62872077-63d5-45d1-b37c-b0b0d440965c,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:01.800701 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:01.843253 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:23:01.850820 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a30a5f-97a1-4ead-adf4-70a3123fd532 None None] Pushing event updated for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:01.922040 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-36f0a8d8-0170-4dad-ade8-076aa5a09370 None None] Provisioning complete for port 62872077-63d5-45d1-b37c-b0b0d440965c triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:01.922410 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-36f0a8d8-0170-4dad-ade8-076aa5a09370 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:02.040438 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:23:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '62872077-63d5-45d1-b37c-b0b0d440965c', 'name': '', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'mac_address': 'fa:16:3e:11:e5:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:56Z', 'updated_at': '2021-12-14T03:23:01Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'subnets': [{'id': '4afceb57-1177-42c8-a230-784269818f59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:02.070124 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4b7ea57-83ec-4e8f-adf0-5729cd3667c8 None None] The sync data for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi is: [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:23:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '62872077-63d5-45d1-b37c-b0b0d440965c', 'name': '', 'network_id': '0d0ab0fa-c270-4b02-af87-b2dad39d1991', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'mac_address': 'fa:16:3e:11:e5:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '4afceb57-1177-42c8-a230-784269818f59', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:56Z', 'updated_at': '2021-12-14T03:23:01Z', 'revision_number': 4, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'subnets': [{'id': '4afceb57-1177-42c8-a230-784269818f59', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:23:02.637635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 59a5ed28-73fb-4b13-8800-72cd70183ae8 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:23:02.688032 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 59a5ed28-73fb-4b13-8800-72cd70183ae8 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:02.688632 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:02.766757 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 62872077-63d5-45d1-b37c-b0b0d440965c up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:23:02.812098 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 62872077-63d5-45d1-b37c-b0b0d440965c triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:02.812468 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:11.253889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:19.682419 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-691112ec-af36-45a2-b35f-d1031a0b24fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:21.877525 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-02c0cf3e-131e-4140-926b-8cfabaa9f861 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:23.596936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:24.516874 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-212af882-2669-4dcf-b998-ee556ff93e71 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-201763541&fields=id&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 267 time: 0.0422928 Dec 14 03:23:24.595066 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:24.623706 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-cd679b01-c5ae-4b4e-a125-f3a2ce6fc6b4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:24.625720 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-cd679b01-c5ae-4b4e-a125-f3a2ce6fc6b4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.1019206 Dec 14 03:23:24.640155 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-2afb91f4-581d-4b48-a55e-b0bc83022b1f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/quotas/d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 375 time: 0.0087254 Dec 14 03:23:24.692824 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-50a27182-a01c-4753-bdc3-1a40451e4558 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0474808 Dec 14 03:23:24.785078 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-038bf7dd-fa55-4356-8d63-124ab9e6d404 service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800524 Dec 14 03:23:25.104898 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-1c86bfd7-734d-4caf-9e6e-bb67d4c52b84 service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3138845 Dec 14 03:23:25.379942 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5945bc88-e920-4e9a-ad22-c0517121a179 req-58293718-eb25-4fc5-a9b9-1bbc7af55162 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0266006 Dec 14 03:23:25.801948 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:26.478037 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-28c84fd4-c4c6-4073-89dc-5082941680f0 req-39c82637-746f-43a5-8ec6-67004f0dd92c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0252993 Dec 14 03:23:26.688040 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-69d360c5-c88b-484c-9597-180a00f31d84 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:26.689461 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-69d360c5-c88b-484c-9597-180a00f31d84 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.1028934 Dec 14 03:23:26.759390 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-03927388-ab32-4085-8b3a-35437e8c9662 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 379 time: 0.0535736 Dec 14 03:23:26.772410 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'port': {'device_id': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'admin_state_up': True, 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'security_groups': ['aa81265e-19a7-4c76-ae75-2b53568fe438']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:23:26.880541 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Made reservation on behalf of d0c4dcf4957d42b896f04f682afeef7b for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:23:26.884591 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.009388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.20.0.7 (8f2d77d5-e58c-4a97-8899-5e1a2da29f69/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5/ee1b94f1-9b24-4f43-ae74-a354e91e38f1) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:23:27.141279 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.174616 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.223452 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:23:27.226622 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:23:27.230376 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:23:27.254192 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:27.269160 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.269515 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.269863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.270214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.270539 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.270873 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.271234 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.272156 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.272488 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.272818 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.273146 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.273470 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.273792 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:27.295302 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:27.295941 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.312982 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-3ef170fc-07c9-4a3d-a995-04d8a1e65168 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5440795 Dec 14 03:23:27.347890 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Request body: {'port': {'device_id': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:23:27.409166 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.483602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-1867a793-8123-4fcf-b1f2-a3f32175d7eb None None] Provisioning complete for port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:27.484203 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1867a793-8123-4fcf-b1f2-a3f32175d7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.519412 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-1867a793-8123-4fcf-b1f2-a3f32175d7eb None None] Port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:23:27.598201 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd984545-c434-43dd-86b5-6cdc4ef125c6 req-288b5cee-d165-4613-b661-1284741872ad tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:27.600272 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dd984545-c434-43dd-86b5-6cdc4ef125c6 req-288b5cee-d165-4613-b661-1284741872ad tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 931 time: 0.0491951 Dec 14 03:23:27.648948 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dd984545-c434-43dd-86b5-6cdc4ef125c6 req-4892170e-ca74-4150-959b-f64d7c2e2e6a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425498 Dec 14 03:23:27.684750 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ee1b94f1-9b24-4f43-ae74-a354e91e38f1 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:23:27.692110 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.704075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Transition to ACTIVE for port object ee1b94f1-9b24-4f43-ae74-a354e91e38f1 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:23:27.707771 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.757080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Pushing event updated for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:27.824250 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Attempting to bind port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:23:27.824616 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Attempting to bind port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:23:27.824946 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Attempting to bind port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:23:27.829450 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:23:27.829774 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Attempting to bind port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:23:27.835307 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 23, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:23:27.835647 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:23:27.836030 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Bound using segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:23:27.836461 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Bound port: ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:23:27.836819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.903881 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:23:27.906819 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:23:27.911544 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.944920 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:27.945524 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:27.946870 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] 10.222.0.20 "PUT /v2.0/ports/ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 200 len: 1093 time: 0.6034224 Dec 14 03:23:27.947328 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:23:27.949536 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5c1b544-86a4-4f9c-8a18-5369d758bebc" -d '{"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:23:27.972509 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3b19cc-82d8-4269-a482-452a331c1d39 service neutron] Pushing event updated for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:28.011710 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:23:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c4dffb6-899a-4976-9b03-a2e34603e2ec x-openstack-request-id: req-6c4dffb6-899a-4976-9b03-a2e34603e2ec {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:23:28.012104 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:23:28.012354 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6c4dffb6-899a-4976-9b03-a2e34603e2ec {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:23:28.012753 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'status': 'completed', 'code': 200} Dec 14 03:23:28.066110 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-d340eba4-ed9b-4c5a-9f86-530c9c89d687 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.067813 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-d340eba4-ed9b-4c5a-9f86-530c9c89d687 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1096 time: 0.0422881 Dec 14 03:23:28.122537 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-aa3ba3e7-8af0-4af0-b306-25526e6d8913 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 200 len: 217 time: 0.0393021 Dec 14 03:23:28.178193 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-648becd0-3fcc-42ee-9c91-ff04699d6878 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.179654 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-648becd0-3fcc-42ee-9c91-ff04699d6878 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0492666 Dec 14 03:23:28.226109 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-ff216e67-14b3-4da9-92d1-11937ccafbb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.227625 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-ff216e67-14b3-4da9-92d1-11937ccafbb4 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392888 Dec 14 03:23:28.321961 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-d003f823-2f2c-4909-95c9-f98f4c64d717 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859478 Dec 14 03:23:28.414919 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5a89eec5-0585-423f-bb1d-252810ac49d3 req-abe8d35f-e747-4162-875b-929fcedcf9a8 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854747 Dec 14 03:23:28.548056 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-c88240c1-f2d8-4b90-9a36-f7c0da6af249 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.549469 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-c88240c1-f2d8-4b90-9a36-f7c0da6af249 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1096 time: 0.0425599 Dec 14 03:23:28.634653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-5dfa0c4c-a533-4bbb-bccc-a59f0076d45d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.636093 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-5dfa0c4c-a533-4bbb-bccc-a59f0076d45d service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0793548 Dec 14 03:23:28.676821 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-3fa34fad-80b7-48d5-a95c-049865b158d6 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 200 len: 217 time: 0.0328529 Dec 14 03:23:28.728313 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-30c6f353-107a-4714-b23f-df56eac56b3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.729744 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-30c6f353-107a-4714-b23f-df56eac56b3f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0457864 Dec 14 03:23:28.768865 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d4b806-41b8-41e8-ab92-593ca7ccb31a req-60894ec3-319a-427d-a2f5-e2559f64c3ba tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.770332 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21d4b806-41b8-41e8-ab92-593ca7ccb31a req-60894ec3-319a-427d-a2f5-e2559f64c3ba tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0517697 Dec 14 03:23:28.775599 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-4e354a80-3c61-4928-ae4e-89c4f7e44e86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:28.777069 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-4e354a80-3c61-4928-ae4e-89c4f7e44e86 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394533 Dec 14 03:23:28.819280 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-21d4b806-41b8-41e8-ab92-593ca7ccb31a req-aa1f88ad-8b31-403f-905b-5fbd332dc7e9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422618 Dec 14 03:23:28.865522 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-a7c60d03-7462-4a91-90c4-dad5d5b65091 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799530 Dec 14 03:23:28.953775 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-cfda4d4b-b960-47dd-8c09-d11ba85ddde3 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814970 Dec 14 03:23:29.933256 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd req-c5b8f2bf-7856-43d8-8301-253065d15adc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:29.934727 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd req-c5b8f2bf-7856-43d8-8301-253065d15adc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0479522 Dec 14 03:23:29.982507 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd req-d80a0f93-064d-4ec5-9186-27a256b0aa7b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420110 Dec 14 03:23:31.100646 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b55d72-fc3d-4e27-a7ff-069d906a6ace req-26cc32fa-50b4-458b-a0fa-fe8e605e9e6d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:31.102075 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-23b55d72-fc3d-4e27-a7ff-069d906a6ace req-26cc32fa-50b4-458b-a0fa-fe8e605e9e6d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0514500 Dec 14 03:23:31.149128 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-23b55d72-fc3d-4e27-a7ff-069d906a6ace req-5bc4a846-0dee-45a1-a364-3f0721b2a38e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412624 Dec 14 03:23:32.262516 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0b725f-293e-4308-876c-b094c401ed82 req-0b5a12bf-0c3f-4ff1-9519-5ef5b90afdd0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:32.263975 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5e0b725f-293e-4308-876c-b094c401ed82 req-0b5a12bf-0c3f-4ff1-9519-5ef5b90afdd0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0473156 Dec 14 03:23:32.310363 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5e0b725f-293e-4308-876c-b094c401ed82 req-7db379f1-dd70-4c62-a5f4-66f938d53317 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407181 Dec 14 03:23:33.424790 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb req-1f59ea29-d918-481e-a9cc-31cb2c1fa6cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:33.426222 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb req-1f59ea29-d918-481e-a9cc-31cb2c1fa6cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0474529 Dec 14 03:23:33.477136 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb req-84c5a315-b9ee-4241-8787-994fb950d6e6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449278 Dec 14 03:23:34.591133 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 req-19864d39-4f13-4161-b4fd-b169fd44a5ba tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:34.592609 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 req-19864d39-4f13-4161-b4fd-b169fd44a5ba tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0478396 Dec 14 03:23:34.639635 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 req-b5256747-3d26-4281-b67c-c4c33e9c0c50 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413647 Dec 14 03:23:35.753591 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325324d8-51b6-4910-8bec-e10458322ed0 req-f8b87a8c-3582-44a8-a525-9314af0f8672 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:35.755031 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-325324d8-51b6-4910-8bec-e10458322ed0 req-f8b87a8c-3582-44a8-a525-9314af0f8672 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0476713 Dec 14 03:23:35.803014 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-325324d8-51b6-4910-8bec-e10458322ed0 req-2cdd573f-6164-4aa5-8684-25a8566cbea4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416303 Dec 14 03:23:36.822543 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device ee1b94f1-9b24-4f43-ae74-a354e91e38f1 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:23:36.917870 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:36.921356 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017be17-251f-4128-a8a9-079832207aca req-0c440c02-2cbb-479f-8543-42bd60a458cb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:36.922887 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8017be17-251f-4128-a8a9-079832207aca req-0c440c02-2cbb-479f-8543-42bd60a458cb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 943 time: 0.0507998 Dec 14 03:23:36.929640 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'port_id': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'mac_address': 'fa:16:3e:c5:98:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 257, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:23:36.964830 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:36.970942 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8017be17-251f-4128-a8a9-079832207aca req-31923dc2-f6e3-4fc6-bcf9-b0512be6a581 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414855 Dec 14 03:23:36.978683 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ee1b94f1-9b24-4f43-ae74-a354e91e38f1 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:23:36.999521 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:37.003176 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:37.051501 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:37.488655 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['ee1b94f1-9b24-4f43-ae74-a354e91e38f1'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:23:37.995967 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:23:38.088584 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 req-f8e04573-e25d-4650-beb6-6609e2901fef tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:38.090051 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 req-f8e04573-e25d-4650-beb6-6609e2901fef tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 944 time: 0.0477862 Dec 14 03:23:38.138224 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 req-45bff198-9e22-4670-8b82-e80ce7c5fb40 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423827 Dec 14 03:23:38.853505 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device ee1b94f1-9b24-4f43-ae74-a354e91e38f1 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:23:38.901735 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:23:38.905455 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:23:38.905824 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:38.980093 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:39.001061 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:23:39.003485 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95" -d '{"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-plugged", "status": "completed", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:23:39.016411 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:39.020648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:39.044089 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:23:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e3d2a2e-494c-4378-a641-658e6dba56fa x-openstack-request-id: req-4e3d2a2e-494c-4378-a641-658e6dba56fa {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:23:39.044375 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-plugged", "status": "completed", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:23:39.044624 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4e3d2a2e-494c-4378-a641-658e6dba56fa {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:23:39.045004 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'code': 200} Dec 14 03:23:39.068504 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:39.253383 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 req-f944f5e2-4911-4518-a607-68b498b8896d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:39.254838 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 req-f944f5e2-4911-4518-a607-68b498b8896d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0482044 Dec 14 03:23:39.300729 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f3b3d3-8275-470d-bce6-d8d392c006c8 req-275af46f-f666-4a70-be41-ca74aa2a6ab4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:39.302390 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d4f3b3d3-8275-470d-bce6-d8d392c006c8 req-275af46f-f666-4a70-be41-ca74aa2a6ab4 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1098 time: 0.0395107 Dec 14 03:23:39.306814 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 req-3b7e02bd-6566-42d4-bf83-fcf2d15a9ffb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460565 Dec 14 03:23:39.348341 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-d4f3b3d3-8275-470d-bce6-d8d392c006c8 req-2c9e55bd-0a4a-427d-8e7c-bc39b997c3fa service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390038 Dec 14 03:23:40.423129 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a670071-8042-44a8-af69-109f5c25549c req-93034413-5f49-4da1-adbc-23f99e8c6baf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:40.424588 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7a670071-8042-44a8-af69-109f5c25549c req-93034413-5f49-4da1-adbc-23f99e8c6baf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0484827 Dec 14 03:23:40.472390 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7a670071-8042-44a8-af69-109f5c25549c req-6f19f363-c69c-47c0-ae9f-5b39a9ea697f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421293 Dec 14 03:23:41.268366 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:41.588777 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e155da70-1c68-415d-bd75-dd6c712d4d8f req-a92847c8-0d95-4396-9693-552e71f94dab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:41.590318 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e155da70-1c68-415d-bd75-dd6c712d4d8f req-a92847c8-0d95-4396-9693-552e71f94dab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0476871 Dec 14 03:23:41.639398 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e155da70-1c68-415d-bd75-dd6c712d4d8f req-035f67ec-c76d-4e0f-b18b-4721abeda156 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432599 Dec 14 03:23:41.757999 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b29607-3caf-4737-aac0-9f6a4079ade8 req-4ce8df34-1914-4add-9beb-fc6254338dec tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:41.759489 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68b29607-3caf-4737-aac0-9f6a4079ade8 req-4ce8df34-1914-4add-9beb-fc6254338dec tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0517642 Dec 14 03:23:41.808294 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68b29607-3caf-4737-aac0-9f6a4079ade8 req-ede51d0a-e92e-45eb-bb17-953f517dff9e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428948 Dec 14 03:23:41.830025 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57072) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:23:41.953207 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84c8c542-d433-4d6b-9079-bf85d2a25a1e tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:41.954810 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-84c8c542-d433-4d6b-9079-bf85d2a25a1e tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1093 time: 0.1237457 Dec 14 03:23:41.957609 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57078) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:23:41.962515 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'port_id': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:23:41.983534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.083127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.183802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.27.3.120 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/abc58b56-3e2c-4bd0-a23a-df172cc00030) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:23:42.289945 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.322683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.357267 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:23:42.360175 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:23:42.363915 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:23:42.390206 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=abc58b56-3e2c-4bd0-a23a-df172cc00030,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:42.713307 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.776984 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.921221 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.925557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:42.992013 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=abc58b56-3e2c-4bd0-a23a-df172cc00030,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:43.003153 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:43.098684 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 0420008b-d84b-485a-9af4-6526ba1176e5 associated. External IP: 172.27.3.120, port: ee1b94f1-9b24-4f43-ae74-a354e91e38f1. Dec 14 03:23:43.298951 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:23:43.405788 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:23:43.416560 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:23:43.426702 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:43.438236 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:23:43.439509 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:23:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:43.471057 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-68583865-47cc-477f-8f8f-1dee448b5fa8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5024149 Dec 14 03:23:43.471057 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:23:43.471057 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c929305-3467-4e48-ac94-750c9d2da4b7" -d '{"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:23:43.514113 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:23:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f x-openstack-request-id: req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:23:43.514401 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:23:43.514650 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:23:43.515069 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'status': 'completed', 'code': 200} Dec 14 03:23:43.560750 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:23:43.607496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-7526ca8e-8c12-450b-85a7-96376d158f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:43.609074 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-7526ca8e-8c12-450b-85a7-96376d158f64 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1098 time: 0.0455592 Dec 14 03:23:43.699211 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-946a9cae-c67a-4974-9926-cf2ce99ccd3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:43.700742 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-946a9cae-c67a-4974-9926-cf2ce99ccd3d service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0827796 Dec 14 03:23:43.769459 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbc98401-de0a-459f-b13c-cb243b3f4ad8 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 200 len: 999 time: 0.0604804 Dec 14 03:23:43.785757 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '0420008b-d84b-485a-9af4-6526ba1176e5', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.120', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:c5:98:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:23:42Z', 'updated_at': '2021-12-14T03:23:42Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:43.811774 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:23:43.817935 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-7b36593d-3d04-4ee6-bfdb-260f220cd2f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:43.819984 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-7b36593d-3d04-4ee6-bfdb-260f220cd2f4 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0434926 Dec 14 03:23:43.820498 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:23:43.821297 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:23:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:43.863929 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-9a664daf-2dc0-453e-96af-7b2dd0e6e3fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:43.865415 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-9a664daf-2dc0-453e-96af-7b2dd0e6e3fc service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0379322 Dec 14 03:23:43.929710 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:23:43.959398 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-b8a2a1d4-f0b5-423a-8668-886262caef76 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843236 Dec 14 03:23:44.048236 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-ea03bbe3-99a9-48de-9341-ee008cf4842c service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814695 Dec 14 03:23:44.149606 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '0420008b-d84b-485a-9af4-6526ba1176e5', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.120', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:c5:98:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:23:42Z', 'updated_at': '2021-12-14T03:23:42Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:23:44.176992 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-282ca425-3d9a-4751-800f-d48cb7f7f3a6 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '0420008b-d84b-485a-9af4-6526ba1176e5', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.120', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:c5:98:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:23:42Z', 'updated_at': '2021-12-14T03:23:42Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:23:44.359562 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07aa56c2-af13-47cb-ad6d-0825151bcd08 None None] New status for floating IP 0420008b-d84b-485a-9af4-6526ba1176e5: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:23:45.788156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 req-4d9fe941-ca24-4595-b3f7-b794ffb5b565 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:45.789616 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 req-4d9fe941-ca24-4595-b3f7-b794ffb5b565 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0477123 Dec 14 03:23:45.834822 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 req-0c48e60e-fc9c-41c6-b6bb-e8a22da19b63 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393441 Dec 14 03:23:46.380730 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-180625d8-1053-4b8c-a26b-f4ee1cc9d018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:46.382745 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-180625d8-1053-4b8c-a26b-f4ee1cc9d018 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1099 time: 0.0399160 Dec 14 03:23:46.504032 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-afd3602e-c133-4f3f-8924-ae06ec3dae81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:46.505507 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-afd3602e-c133-4f3f-8924-ae06ec3dae81 service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0967484 Dec 14 03:23:46.587509 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-c1203cdc-3b99-4643-bb66-8e3729e868ef service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 1002 time: 0.0572975 Dec 14 03:23:46.637971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-2bcf9297-6a05-4da6-88b1-d0d40695f8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:46.639281 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-2bcf9297-6a05-4da6-88b1-d0d40695f8ed service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0449905 Dec 14 03:23:46.685410 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-475bbea1-0e39-48ed-8065-ec4bfbe4d6cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:46.686885 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-475bbea1-0e39-48ed-8065-ec4bfbe4d6cd service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391970 Dec 14 03:23:46.771138 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-5cd4cab9-5dd9-42b2-9013-688c0e02a870 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0767949 Dec 14 03:23:46.862157 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-c9161095-bf62-41f8-bb65-cd426693f2a8 req-bcc130f3-98c2-4a95-b265-f22fb6fbe378 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827372 Dec 14 03:23:46.955721 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5482051-7eb5-4500-9730-4e5ea8801be2 req-d8d44b5d-80cb-41e1-ba8c-9f928144551d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:46.957092 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e5482051-7eb5-4500-9730-4e5ea8801be2 req-d8d44b5d-80cb-41e1-ba8c-9f928144551d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0485234 Dec 14 03:23:47.003657 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e5482051-7eb5-4500-9730-4e5ea8801be2 req-3ffda02f-22b3-455b-a0b2-d866bf12b246 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0402465 Dec 14 03:23:48.124180 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee9fe64-6075-419b-ad90-6d3427b6269a req-1a3bffdf-f57d-46de-9388-be25e19cc934 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:48.125633 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ee9fe64-6075-419b-ad90-6d3427b6269a req-1a3bffdf-f57d-46de-9388-be25e19cc934 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0517378 Dec 14 03:23:48.170922 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ee9fe64-6075-419b-ad90-6d3427b6269a req-a5112fbb-d9f2-4b45-bb5b-06e112a211f5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0394762 Dec 14 03:23:49.286544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc121754-2807-4653-a0e6-22d0cc9b0a4e req-b77c36d0-318f-4fdc-b503-0ebbb79b651f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:49.288590 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc121754-2807-4653-a0e6-22d0cc9b0a4e req-b77c36d0-318f-4fdc-b503-0ebbb79b651f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0467196 Dec 14 03:23:49.332520 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dc121754-2807-4653-a0e6-22d0cc9b0a4e req-d1ab4d91-8617-4d17-bfec-fb7713c027a8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0381806 Dec 14 03:23:49.684148 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-36b1c887-7484-438e-ba9a-05306170656c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:50.449535 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f req-55b845f4-94d0-4e9d-b9f9-0f5fc9be07b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:50.451141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f req-55b845f4-94d0-4e9d-b9f9-0f5fc9be07b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0468760 Dec 14 03:23:50.500435 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f req-87ca280f-5be7-4e38-b86b-fb4b0b9bd5cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0435252 Dec 14 03:23:51.629028 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 req-09c221bc-b06d-4a76-b558-51d739ac5bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:51.630485 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 req-09c221bc-b06d-4a76-b558-51d739ac5bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0482881 Dec 14 03:23:51.677284 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 req-2e21be4f-5ccd-4b8f-aaf7-2d51be814788 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0403237 Dec 14 03:23:51.879051 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-17b7144b-3e3c-4251-b1c3-bda3b7d55ad1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:52.794088 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 req-ee573abc-e5c5-411f-95af-261042fc261b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:52.795537 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 req-ee573abc-e5c5-411f-95af-261042fc261b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0462067 Dec 14 03:23:52.841379 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 req-d3fe24c2-82a9-4895-88ff-5ae0d3c922fe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0399466 Dec 14 03:23:53.604169 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:53.961855 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 req-10ca20f5-a59d-4578-b7bf-3fc47f19f7d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:53.963407 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 req-10ca20f5-a59d-4578-b7bf-3fc47f19f7d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0517251 Dec 14 03:23:54.008698 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 req-c1b51d8d-71e7-4023-bca2-5e5c51abc20b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0394452 Dec 14 03:23:54.597667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:55.125188 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 req-1578f031-cdd6-4763-8f33-337445d3a494 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:55.126625 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 req-1578f031-cdd6-4763-8f33-337445d3a494 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0476661 Dec 14 03:23:55.171977 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 req-ac67cada-cff4-4f8e-a498-1535eda4e915 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0395353 Dec 14 03:23:55.805897 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:56.292161 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 req-2cea2e73-e11b-4fa1-8bab-bc96a270142c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:56.293622 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 req-2cea2e73-e11b-4fa1-8bab-bc96a270142c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0503173 Dec 14 03:23:56.339175 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 req-da9636b9-07a0-48e5-9ee0-133ccce0ce39 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396669 Dec 14 03:23:57.456552 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 req-8f5d7d0f-e08c-4a98-ad92-6c62f8e57d4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:57.458017 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 req-8f5d7d0f-e08c-4a98-ad92-6c62f8e57d4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0474222 Dec 14 03:23:57.503428 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 req-e86aa074-901e-43d3-9c5c-bb27417858d4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0395317 Dec 14 03:23:58.629204 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d req-6469cd7c-0fb1-48ad-a07c-8013a84aa50c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:58.630671 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d req-6469cd7c-0fb1-48ad-a07c-8013a84aa50c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0542569 Dec 14 03:23:58.679978 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d req-70c80e55-4908-452c-9ac2-5a1d2c81b8d8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434370 Dec 14 03:23:59.027157 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:23:59.120849 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:59.135931 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:23:59.292830 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:59.304913 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:23:59.324488 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:23:59.328268 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:23:59.373808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=6']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:23:59.380510 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.381408 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.381755 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.382092 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.382420 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.382748 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.383193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.383520 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.383844 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.384167 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.384489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.384807 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.385125 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:23:59.491480 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9eee83b0-b14c-403e-a6bd-7d2515f7e214'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:23:59.795932 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 req-78c2e44e-58b8-485f-b33c-8910cb2b6308 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:23:59.797373 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 req-78c2e44e-58b8-485f-b33c-8910cb2b6308 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0473022 Dec 14 03:23:59.842558 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 req-59511c62-7b81-4166-932e-9fe65a47f5cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393825 Dec 14 03:24:00.956635 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003da9ab-5277-456e-a20c-e1fa621dccfb req-9a9ca27d-ea01-428c-aca7-2a614a9e561a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:00.958065 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-003da9ab-5277-456e-a20c-e1fa621dccfb req-9a9ca27d-ea01-428c-aca7-2a614a9e561a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0465436 Dec 14 03:24:01.003150 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-003da9ab-5277-456e-a20c-e1fa621dccfb req-80ff4e50-d712-4ad8-97c6-31be574ec59f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0392749 Dec 14 03:24:01.030839 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:24:01.076596 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:24:01.076971 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:01.151550 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:01.173003 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:24:01.175258 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26c2b607-439b-4b72-966a-9b7ebbb078f9" -d '{"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:24:01.187521 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:01.191474 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:01.220634 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:24:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-321496fd-6ffb-41af-843d-e63592e855c6 x-openstack-request-id: req-321496fd-6ffb-41af-843d-e63592e855c6 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:24:01.220926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:24:01.221176 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-321496fd-6ffb-41af-843d-e63592e855c6 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:24:01.221556 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'code': 200} Dec 14 03:24:01.242028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=7']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:02.124670 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c969405e-f6af-43fa-aaac-57e238efe23e req-17d80898-3637-4e67-aa6b-9d339cef348c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:02.126130 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c969405e-f6af-43fa-aaac-57e238efe23e req-17d80898-3637-4e67-aa6b-9d339cef348c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0509162 Dec 14 03:24:02.172248 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c969405e-f6af-43fa-aaac-57e238efe23e req-aba6c032-9896-45db-b817-721e600e74c0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393434 Dec 14 03:24:03.293741 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26513608-41d9-4746-8e93-1868e9eea64a req-3d10435a-e1b3-495c-9fb4-16ce8d8f3107 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:03.295599 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-26513608-41d9-4746-8e93-1868e9eea64a req-3d10435a-e1b3-495c-9fb4-16ce8d8f3107 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0509360 Dec 14 03:24:03.345558 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-26513608-41d9-4746-8e93-1868e9eea64a req-ff84466a-ff9d-4025-a7e3-85a8e0745958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438614 Dec 14 03:24:04.471994 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13b42e8a-15e7-4702-9e2e-c1157f204396 req-72d7bbfc-fe84-43eb-990d-d3406fedab4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:04.473468 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-13b42e8a-15e7-4702-9e2e-c1157f204396 req-72d7bbfc-fe84-43eb-990d-d3406fedab4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0474372 Dec 14 03:24:04.547716 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-13b42e8a-15e7-4702-9e2e-c1157f204396 req-9ec8c4f2-29a0-4d8f-8d1b-fe758f8e4519 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0673165 Dec 14 03:24:05.688585 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 req-187d9f70-2d01-44a4-b127-8be38caef8a6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:05.690242 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 req-187d9f70-2d01-44a4-b127-8be38caef8a6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0589583 Dec 14 03:24:05.740721 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 req-2b2d2f07-731a-4ce1-8f92-4d484d6a5fa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441029 Dec 14 03:24:06.869421 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f344f449-b6b4-4ef1-959e-5a1960f5d10e req-efd79e1b-f06f-41ba-89d9-108a73c91222 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:06.871008 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f344f449-b6b4-4ef1-959e-5a1960f5d10e req-efd79e1b-f06f-41ba-89d9-108a73c91222 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0528078 Dec 14 03:24:06.921741 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f344f449-b6b4-4ef1-959e-5a1960f5d10e req-122f3f5e-dae1-427f-8626-79efd75467a4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0445046 Dec 14 03:24:08.063621 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005a51d9-17ed-42bf-a99f-b15b300b919b req-3a4389d1-1f32-4ec6-9861-5f896069f105 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:08.065127 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-005a51d9-17ed-42bf-a99f-b15b300b919b req-3a4389d1-1f32-4ec6-9861-5f896069f105 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0529749 Dec 14 03:24:08.116323 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-005a51d9-17ed-42bf-a99f-b15b300b919b req-f1301240-0ff1-4600-af45-b592c7f0a691 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0443416 Dec 14 03:24:09.242389 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e req-a52cbd0f-bdf6-4f35-a0a3-a468e35ae7e1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:09.243932 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e req-a52cbd0f-bdf6-4f35-a0a3-a468e35ae7e1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0502062 Dec 14 03:24:09.301166 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e req-2ff6bb82-62a7-49a5-9fcd-2d41ac7a9e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0460882 Dec 14 03:24:10.491810 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d591e50-7bf7-480e-851f-5fa8ae390153 req-6f660a15-2b1f-4102-b1ff-68ebe6c2a6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:10.491810 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d591e50-7bf7-480e-851f-5fa8ae390153 req-6f660a15-2b1f-4102-b1ff-68ebe6c2a6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0676186 Dec 14 03:24:10.561328 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d591e50-7bf7-480e-851f-5fa8ae390153 req-1d27b6ff-7978-4857-a32a-067e1db8fdd5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0633914 Dec 14 03:24:11.273006 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:11.725303 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8000449-951a-4f83-8ce8-477ae40404ee req-2e6df6e2-e02e-46d9-ab2c-750cbe21274b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:11.726799 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8000449-951a-4f83-8ce8-477ae40404ee req-2e6df6e2-e02e-46d9-ab2c-750cbe21274b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0530283 Dec 14 03:24:11.775361 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b8000449-951a-4f83-8ce8-477ae40404ee req-d3e22ae9-cb58-4162-933f-d0065f8afc66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420861 Dec 14 03:24:12.909477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b987d12-4452-416c-8a81-6a43d29bcb08 req-63143b66-1d8e-4403-86e1-e44620b3c4fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:12.915506 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5b987d12-4452-416c-8a81-6a43d29bcb08 req-63143b66-1d8e-4403-86e1-e44620b3c4fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0627866 Dec 14 03:24:12.963774 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5b987d12-4452-416c-8a81-6a43d29bcb08 req-15b05208-4566-458b-96cd-9c9b3ea007c0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0465662 Dec 14 03:24:14.081071 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee22e79-9304-49f8-91c3-ede44f0ae319 req-6280f884-ef8c-4202-a5af-07aaa2a75909 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:14.082522 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bee22e79-9304-49f8-91c3-ede44f0ae319 req-6280f884-ef8c-4202-a5af-07aaa2a75909 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0468473 Dec 14 03:24:14.128459 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bee22e79-9304-49f8-91c3-ede44f0ae319 req-701e81fe-277c-47a2-bef9-0750a27d977d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0395706 Dec 14 03:24:14.473604 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6183f656-b34e-476f-b4f2-ff15146039aa req-1cc2dce2-15af-4b37-a79a-b8392af5ec8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:14.475087 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-1cc2dce2-15af-4b37-a79a-b8392af5ec8d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1099 time: 0.0394926 Dec 14 03:24:14.569030 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6183f656-b34e-476f-b4f2-ff15146039aa req-0498253c-487d-4886-be49-a595deb98dbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:14.570477 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-0498253c-487d-4886-be49-a595deb98dbc service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0868371 Dec 14 03:24:14.633815 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-f9d4ccca-cfda-4957-898b-72aedff6fc9d service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 1002 time: 0.0558958 Dec 14 03:24:14.680934 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6183f656-b34e-476f-b4f2-ff15146039aa req-6fa6bab6-9cfc-455e-a5ff-40cfa2576c75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:14.682345 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-6fa6bab6-9cfc-455e-a5ff-40cfa2576c75 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0409639 Dec 14 03:24:14.728936 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6183f656-b34e-476f-b4f2-ff15146039aa req-bcbddc6e-6244-4e85-bcd0-dcf4f28a0149 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:14.730267 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-bcbddc6e-6244-4e85-bcd0-dcf4f28a0149 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407133 Dec 14 03:24:14.814012 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-0b4914a3-02e7-46ce-92dc-4c58b81ebfa9 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0767279 Dec 14 03:24:14.901592 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6183f656-b34e-476f-b4f2-ff15146039aa req-43d800a2-b3bc-4196-824f-dd25790d3b64 service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802677 Dec 14 03:24:14.995873 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:24:15.246567 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8585ba3a-5e24-4094-83ae-e04f32f77478 req-41fe5b99-03bd-425f-90ac-2beb3b6601b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:15.247945 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8585ba3a-5e24-4094-83ae-e04f32f77478 req-41fe5b99-03bd-425f-90ac-2beb3b6601b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0473623 Dec 14 03:24:15.292773 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8585ba3a-5e24-4094-83ae-e04f32f77478 req-5c731000-6d01-460f-8000-7a3b56f82f34 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0390849 Dec 14 03:24:16.423842 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaec5d54-aa47-4468-abae-2a8e6069a270 req-e2b461be-9878-4974-b8b6-f82497a8fab8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:16.425370 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aaec5d54-aa47-4468-abae-2a8e6069a270 req-e2b461be-9878-4974-b8b6-f82497a8fab8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 946 time: 0.0568943 Dec 14 03:24:16.475274 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aaec5d54-aa47-4468-abae-2a8e6069a270 req-90704930-182a-44dd-a842-081d19a8464f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0432878 Dec 14 03:24:17.124060 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:24:17.202027 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:17.223131 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:24:17.225875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33895bb5-4b5c-4e14-8341-64c20f1d5999" -d '{"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-unplugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:24:17.238758 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:17.243427 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:17.265446 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 14 Dec 2021 03:24:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1297447b-b253-4edd-9fb8-47633dc3b85f x-openstack-request-id: req-1297447b-b253-4edd-9fb8-47633dc3b85f {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:24:17.265735 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-unplugged", "status": "failed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "code": 422}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:24:17.265986 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1297447b-b253-4edd-9fb8-47633dc3b85f {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:24:17.266383 dv-cinder-818037-8-iscsi neutron-server[102573]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'code': 422} returned with failed status Dec 14 03:24:17.290499 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=8']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:17.592079 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81ebc6f-1919-462c-a41a-d177d5771f27 req-398c1855-efb1-4205-88e5-6357e40413cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:17.593550 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a81ebc6f-1919-462c-a41a-d177d5771f27 req-398c1855-efb1-4205-88e5-6357e40413cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0473771 Dec 14 03:24:17.640570 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a81ebc6f-1919-462c-a41a-d177d5771f27 req-380bc088-48b7-4494-b8a5-de2fffb7f374 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0405614 Dec 14 03:24:18.461023 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-75afde9a-d0e9-43db-b0b9-ae87807fdde0 req-170d5bdf-a309-4591-95d0-25e4d0e41076 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:24:18.461972 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75afde9a-d0e9-43db-b0b9-ae87807fdde0 req-170d5bdf-a309-4591-95d0-25e4d0e41076 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052967 Dec 14 03:24:18.619931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692ba68b-da34-4567-ab98-dda1a9e30687 req-408a85da-a285-4b6e-a21b-8dccf995a51d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:18.621414 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-692ba68b-da34-4567-ab98-dda1a9e30687 req-408a85da-a285-4b6e-a21b-8dccf995a51d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0478933 Dec 14 03:24:18.675614 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-692ba68b-da34-4567-ab98-dda1a9e30687 req-580c0c19-2876-43cc-97cf-164296236f00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0479751 Dec 14 03:24:18.912831 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-046601cf-613c-4ee3-850e-8885e6b301d5 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3070371 Dec 14 03:24:19.687602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d84b3de6-e892-4143-83e3-f6340a72656c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:19.712631 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-f5c39f85-af76-4fc5-af6f-702209c96bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:19.714129 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-f5c39f85-af76-4fc5-af6f-702209c96bee service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f&tenant_id=da53d564588b46b7bd658659f40a6ded HTTP/1.1" status: 200 len: 1097 time: 0.0421603 Dec 14 03:24:19.790290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-c4cb8476-3e92-4713-9a36-9544602cbe3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:19.791814 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-c4cb8476-3e92-4713-9a36-9544602cbe3b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=da53d564588b46b7bd658659f40a6ded&device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1097 time: 0.0396152 Dec 14 03:24:19.797075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25ca9298-a365-46ba-9554-9758eb679e6a req-6f331101-6834-44b8-97a3-1e8be0f52674 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:19.798520 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25ca9298-a365-46ba-9554-9758eb679e6a req-6f331101-6834-44b8-97a3-1e8be0f52674 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0481079 Dec 14 03:24:19.844359 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25ca9298-a365-46ba-9554-9758eb679e6a req-9e8c8533-53be-493b-97a6-751c73f177a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0397532 Dec 14 03:24:19.883207 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-22f3787f-8570-44e8-b715-362a1579f18b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:19.884676 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-22f3787f-8570-44e8-b715-362a1579f18b service neutron] 10.222.0.20 "GET /v2.0/networks?id=61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 200 len: 918 time: 0.0855732 Dec 14 03:24:19.949537 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-c95d83e6-e62e-41aa-b418-b09eca12b501 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 200 len: 1000 time: 0.0568686 Dec 14 03:24:20.000613 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-68b49da7-b33b-4121-9574-2bbaaaa6a521 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:20.002040 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-68b49da7-b33b-4121-9574-2bbaaaa6a521 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 200 len: 856 time: 0.0463150 Dec 14 03:24:20.046388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-7889452d-6753-4643-b670-31d70d422b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:20.047861 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-7889452d-6753-4643-b670-31d70d422b99 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=61e8c126-6b7d-4549-9293-90629e6175d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0386355 Dec 14 03:24:20.133900 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-10aefd9a-dd08-4592-bfd8-46b15ae37a9a service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785222 Dec 14 03:24:20.224181 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-afd95a4c-ddfc-4040-b90d-6db049d77896 req-69da85a4-986b-4b50-a98d-7e54b9bcdc9f service neutron] 10.222.0.20 "GET /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823610 Dec 14 03:24:20.977654 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841b6987-697f-4f1b-8907-7cabf56e00ac req-49ed0005-cfca-412d-9356-ebf5b14811bc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:20.979146 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-841b6987-697f-4f1b-8907-7cabf56e00ac req-49ed0005-cfca-412d-9356-ebf5b14811bc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0524390 Dec 14 03:24:21.028142 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-841b6987-697f-4f1b-8907-7cabf56e00ac req-3651fba1-d38b-42eb-a04b-86721a4879a2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431139 Dec 14 03:24:21.136672 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:24:21.881387 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2e1c22c3-a117-46a4-b374-a40303bd5c31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:22.153133 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea18764-811f-4d97-b279-208e3b6c28af req-81b0e040-dbbc-4001-afab-9328955882c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:22.154606 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ea18764-811f-4d97-b279-208e3b6c28af req-81b0e040-dbbc-4001-afab-9328955882c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0518827 Dec 14 03:24:22.202083 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ea18764-811f-4d97-b279-208e3b6c28af req-502c1fc2-313a-4783-b657-eaacf176296b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415084 Dec 14 03:24:23.323743 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 req-3d19d3e1-e5c1-4157-bb7f-55f560ca0370 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:23.325199 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 req-3d19d3e1-e5c1-4157-bb7f-55f560ca0370 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0480111 Dec 14 03:24:23.370282 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 req-d0995000-e413-431b-998d-b260f3b0afda tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0392611 Dec 14 03:24:23.604142 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:24.512236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc46b38-e1b1-4864-9096-3d4945f9b507 req-40466be5-8f1f-4239-8b9d-ea50dc28fc32 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:24.513899 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc46b38-e1b1-4864-9096-3d4945f9b507 req-40466be5-8f1f-4239-8b9d-ea50dc28fc32 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0740068 Dec 14 03:24:24.561380 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc46b38-e1b1-4864-9096-3d4945f9b507 req-3fea6e6d-7fef-4037-8551-2da55d14b116 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0416048 Dec 14 03:24:24.602018 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:25.680276 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5307b94-fc13-4279-bd80-37c46af1cb21 req-e5c12939-98ef-4116-bfe1-4e86f62a2ff9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:25.682466 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e5307b94-fc13-4279-bd80-37c46af1cb21 req-e5c12939-98ef-4116-bfe1-4e86f62a2ff9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0497167 Dec 14 03:24:25.732623 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e5307b94-fc13-4279-bd80-37c46af1cb21 req-491287d1-3c0d-41e3-b294-bd665367d5ce tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0440030 Dec 14 03:24:25.810996 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:26.852651 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 req-34666db4-143c-4d54-91d6-de2d19b56804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:26.854066 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 req-34666db4-143c-4d54-91d6-de2d19b56804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0478644 Dec 14 03:24:26.902914 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 req-18e02a6f-0ec3-4301-a835-6876a850de6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428846 Dec 14 03:24:28.022521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 req-1b1c4825-6eb9-4d4d-b9a6-c52252b23c93 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:28.023976 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 req-1b1c4825-6eb9-4d4d-b9a6-c52252b23c93 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0471649 Dec 14 03:24:28.072792 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 req-d1547d97-d783-4b72-b8c0-8c8ed654c512 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429804 Dec 14 03:24:29.209737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8826a076-4ae8-49ef-b3d4-8f714a87c69b req-3b68b3de-e60b-45c3-a24e-334055ba6635 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:29.211236 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8826a076-4ae8-49ef-b3d4-8f714a87c69b req-3b68b3de-e60b-45c3-a24e-334055ba6635 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0669346 Dec 14 03:24:29.258139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8826a076-4ae8-49ef-b3d4-8f714a87c69b req-7b469886-7943-4e2c-8ec6-806b415a6b82 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409300 Dec 14 03:24:30.634644 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 req-f4582a06-505b-4c4d-a638-72d638acec3b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:30.636243 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 req-f4582a06-505b-4c4d-a638-72d638acec3b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.2989953 Dec 14 03:24:30.689584 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 req-6608e2af-04b2-43d7-9558-61c28e562066 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417891 Dec 14 03:24:31.861577 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f5913f-6287-4710-81df-956f51c6bf24 req-97aed8d1-dad9-4c06-b8d7-536fab369c70 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:31.864178 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-42f5913f-6287-4710-81df-956f51c6bf24 req-97aed8d1-dad9-4c06-b8d7-536fab369c70 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.1042612 Dec 14 03:24:31.915007 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-42f5913f-6287-4710-81df-956f51c6bf24 req-5381aa62-cb00-48e0-a110-aa0eacb28bc0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0430052 Dec 14 03:24:33.032652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441b1051-d456-47fa-838a-b37e6c6194b6 req-84452e64-04ee-425b-bd22-f547246f3f13 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:33.034076 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-441b1051-d456-47fa-838a-b37e6c6194b6 req-84452e64-04ee-425b-bd22-f547246f3f13 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0466156 Dec 14 03:24:33.082679 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-441b1051-d456-47fa-838a-b37e6c6194b6 req-3fda8ab4-3d91-45a6-a82f-35988a815fbf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428102 Dec 14 03:24:34.201969 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e req-2d9a68a5-4b35-4441-b436-ab717aa0bfe7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:34.203401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e req-2d9a68a5-4b35-4441-b436-ab717aa0bfe7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0459635 Dec 14 03:24:34.249018 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e req-de2d6a96-178b-4d4c-9fb1-83e0b6a5110d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0392251 Dec 14 03:24:35.412419 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 req-9ad7f338-e683-4d30-a8a6-ca31c56dde4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:35.413865 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 req-9ad7f338-e683-4d30-a8a6-ca31c56dde4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0948751 Dec 14 03:24:35.458683 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 req-03c2cb3f-2ad2-4bb9-9c68-86aea8205a32 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0389040 Dec 14 03:24:36.578221 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a52714a-5321-421e-97af-143775ac1b7b req-3a7e34ea-67d9-4b88-8b53-cb6fcd7dba46 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:36.579683 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6a52714a-5321-421e-97af-143775ac1b7b req-3a7e34ea-67d9-4b88-8b53-cb6fcd7dba46 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0500450 Dec 14 03:24:36.625420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6a52714a-5321-421e-97af-143775ac1b7b req-a04b6002-9011-4880-87f1-18dc5881a4d8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0398726 Dec 14 03:24:37.742059 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 req-cc023f69-8ea4-4b58-ba9c-b35f8c507728 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:37.743521 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 req-cc023f69-8ea4-4b58-ba9c-b35f8c507728 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0478897 Dec 14 03:24:37.788069 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 req-c7d72a24-c897-4f3c-8319-2b9ab5ac5db0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387011 Dec 14 03:24:38.906308 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05afa45-9882-437e-abeb-279c87d0109f req-305fcd05-5d5d-4484-b8d0-ea6047bb7960 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:38.907848 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e05afa45-9882-437e-abeb-279c87d0109f req-305fcd05-5d5d-4484-b8d0-ea6047bb7960 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 944 time: 0.0492508 Dec 14 03:24:38.958706 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e05afa45-9882-437e-abeb-279c87d0109f req-af47c71a-ccd0-451a-b5fa-6a002940b7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0449851 Dec 14 03:24:39.273633 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:24:39.369038 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:39.379874 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'port_id': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'mac_address': 'fa:16:3e:45:27:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 267, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:24:39.419372 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:39.432100 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:24:39.451196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:39.454661 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:39.498546 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=9']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:39.891635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['9eee83b0-b14c-403e-a6bd-7d2515f7e214'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:24:40.080286 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c0d8f7-fc06-410c-9c04-a732caedb114 req-2dadf82d-7f4c-467e-9ab1-790d085f0554 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:40.081733 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a9c0d8f7-fc06-410c-9c04-a732caedb114 req-2dadf82d-7f4c-467e-9ab1-790d085f0554 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0472565 Dec 14 03:24:40.127182 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a9c0d8f7-fc06-410c-9c04-a732caedb114 req-25bbfa1a-0447-478a-9aba-453ba396af67 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396631 Dec 14 03:24:41.241922 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 req-f554ac5b-09a1-44f8-8683-8001bf625659 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:41.243372 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 req-f554ac5b-09a1-44f8-8683-8001bf625659 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 945 time: 0.0462835 Dec 14 03:24:41.273955 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:24:41.290891 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 req-e2c51175-c58a-4be4-8d6d-dbb58dde99c5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417533 Dec 14 03:24:41.300999 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:41.323391 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:24:41.323758 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:41.401457 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:41.423549 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:24:41.425693 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b" -d '{"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:24:41.438170 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:41.442239 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:41.466855 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:24:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f464275-64f4-4158-abc6-4babd8ab793f x-openstack-request-id: req-7f464275-64f4-4158-abc6-4babd8ab793f {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:24:41.467167 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:24:41.467420 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-7f464275-64f4-4158-abc6-4babd8ab793f {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:24:41.467808 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'code': 200} Dec 14 03:24:41.492311 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=10']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:41.702087 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1399461-f2ce-46d8-a64f-c4753541f077 req-4929c30c-e66b-4e1a-9de4-0426c77ebed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:41.703490 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a1399461-f2ce-46d8-a64f-c4753541f077 req-4929c30c-e66b-4e1a-9de4-0426c77ebed8 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 1100 time: 0.0397069 Dec 14 03:24:41.747457 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-a1399461-f2ce-46d8-a64f-c4753541f077 req-aa5b9bf9-4033-4cb0-8c81-987e1f69410f service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0363204 Dec 14 03:24:42.413328 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5026772d-8ada-4700-9a65-7c6300a0d117 req-cbd42c69-610b-4f01-ace6-15c28f930b4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:42.414773 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5026772d-8ada-4700-9a65-7c6300a0d117 req-cbd42c69-610b-4f01-ace6-15c28f930b4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0511312 Dec 14 03:24:42.459999 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5026772d-8ada-4700-9a65-7c6300a0d117 req-19de3706-e525-423c-9d99-0437acb59ce8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393400 Dec 14 03:24:43.584466 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b76246a-ab1e-4af5-86a0-943cd20703ba req-c511583f-f070-4fc8-9061-13fed2b20dc2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:43.585988 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b76246a-ab1e-4af5-86a0-943cd20703ba req-c511583f-f070-4fc8-9061-13fed2b20dc2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0494664 Dec 14 03:24:43.633663 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2b76246a-ab1e-4af5-86a0-943cd20703ba req-bd388c8e-8401-4227-a5a0-55e648a7ead0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0414724 Dec 14 03:24:44.753775 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2154de7d-6dba-4165-b976-8a17e30bcb98 req-ddf3833f-e55b-425e-b0c7-bdec68a3fb1f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:44.755250 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2154de7d-6dba-4165-b976-8a17e30bcb98 req-ddf3833f-e55b-425e-b0c7-bdec68a3fb1f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0506930 Dec 14 03:24:44.800492 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2154de7d-6dba-4165-b976-8a17e30bcb98 req-43543cb6-35ed-400e-b130-9d7c1807fa8f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0385861 Dec 14 03:24:46.315853 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-06621898-5b63-4db1-9950-a6ec9fcc59c2 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0375853 Dec 14 03:24:46.398356 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-6b950808-b19a-4ef0-9373-60948156fb6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:46.399883 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-6b950808-b19a-4ef0-9373-60948156fb6f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=11634c00674445cb81d9dabfbcc791a8&device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 1099 time: 0.0451040 Dec 14 03:24:46.502976 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-bbde1010-268b-45d0-aaff-39bc9f8914f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:46.504464 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-bbde1010-268b-45d0-aaff-39bc9f8914f2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 200 len: 911 time: 0.0849862 Dec 14 03:24:46.576669 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-f0019949-5937-47f7-a05c-fb40c20d0eba service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a HTTP/1.1" status: 200 len: 1001 time: 0.0640004 Dec 14 03:24:46.631444 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-46d249b3-6ced-4caf-b1ab-c415ab89630a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:46.633464 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-46d249b3-6ced-4caf-b1ab-c415ab89630a service neutron] 10.222.0.20 "GET /v2.0/subnets?id=cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 200 len: 849 time: 0.0474436 Dec 14 03:24:46.680677 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-c1223642-27aa-4a2a-beee-c670943d5f51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:46.682223 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-c1223642-27aa-4a2a-beee-c670943d5f51 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=7e397d2e-d5ba-40c3-8051-57991a288ab3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414095 Dec 14 03:24:46.693015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-cf5d95d2-720e-4d20-a15a-c3a83a8572dd service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:24:46.693947 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-cf5d95d2-720e-4d20-a15a-c3a83a8572dd service neutron] 10.222.0.20 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050728 Dec 14 03:24:46.784312 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-da263116-1437-49c6-b3c1-b503f7114495 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832262 Dec 14 03:24:46.871551 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-49e4e743-3a46-48b8-8ff0-bd655a9b7f14 req-09d15b3c-cb2c-4b2b-ab86-8addcc541fa8 service neutron] 10.222.0.20 "GET /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787532 Dec 14 03:24:49.689602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7f248e44-f546-45b1-a0ec-f6ee0de76f8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:50.508594 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 req-a2070120-766c-4046-8447-c6ad3bb4a38a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:50.509959 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 req-a2070120-766c-4046-8447-c6ad3bb4a38a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0471570 Dec 14 03:24:50.555738 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 req-ad1b44cb-4511-4880-80b1-a7b7b7043e16 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399334 Dec 14 03:24:51.670136 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 req-34a29f0a-4e7d-47bd-9b4a-861d5fe6d687 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:51.671634 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 req-34a29f0a-4e7d-47bd-9b4a-861d5fe6d687 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0484393 Dec 14 03:24:51.720797 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 req-4b7a551b-0c62-486e-b345-f6e62a04fbd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433130 Dec 14 03:24:51.881920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1d038dce-33b2-48c7-832c-ec16ccb85166 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:51.995191 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:24:52.626044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6340328d-67c2-4b85-8a78-030f50083911 req-dd7aaa28-392f-4a3f-b9f9-faf1f871c826 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:52.627491 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6340328d-67c2-4b85-8a78-030f50083911 req-dd7aaa28-392f-4a3f-b9f9-faf1f871c826 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0475099 Dec 14 03:24:52.721427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Deleting port cf2ca0eb-9e28-4a89-8062-525c1792d08a {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:24:52.721767 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:52.807824 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] For port cf2ca0eb-9e28-4a89-8062-525c1792d08a, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=cf2ca0eb-9e28-4a89-8062-525c1792d08a,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:52.808172 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:52.834827 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477577c1-3238-435f-a5e9-18c869d973f5 req-f7964119-5b21-4786-8b4d-fa95e46d3a23 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:24:52.836948 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-477577c1-3238-435f-a5e9-18c869d973f5 req-f7964119-5b21-4786-8b4d-fa95e46d3a23 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 946 time: 0.0486073 Dec 14 03:24:52.884420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-477577c1-3238-435f-a5e9-18c869d973f5 req-fae2ace5-6e35-4e62-82a2-21ef86dc3a2a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups?id=82422a55-c106-4735-9c53-08650620c7f6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413742 Dec 14 03:24:52.981026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:52.981385 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:52.981701 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Floating IP 06546c06-fc07-462f-b88d-cb1be5de718e disassociated. External IP: 172.27.3.30, port: cf2ca0eb-9e28-4a89-8062-525c1792d08a. Dec 14 03:24:52.982047 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling delete_port for cf2ca0eb-9e28-4a89-8062-525c1792d08a owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:24:53.106914 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:53.137999 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'Port': ['ID=cf2ca0eb-9e28-4a89-8062-525c1792d08a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:53.148510 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.148863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.149209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.149546 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.149875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.150199 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.150525 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.150850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.151202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.151529 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.151850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.152169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.152486 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:53.259184 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:24:53.362874 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:24:53.372842 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:24:53.382113 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:24:53.382737 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:24:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:24:53.401620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] No DVR routers for this DVR port cf2ca0eb-9e28-4a89-8062-525c1792d08a on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:24:53.404231 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:53.407832 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6340328d-67c2-4b85-8a78-030f50083911 req-b76ebcc5-7db9-4df0-9a70-46418a9aa790 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.20 "DELETE /v2.0/ports/cf2ca0eb-9e28-4a89-8062-525c1792d08a HTTP/1.1" status: 204 len: 173 time: 0.7732930 Dec 14 03:24:53.408221 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'name': 'network-vif-deleted', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:24:53.410532 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06666e17-21c9-43e2-bbc9-b625d7af6f28" -d '{"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-deleted", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:24:53.451100 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:24:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d x-openstack-request-id: req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:24:53.451397 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-deleted", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:24:53.451672 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:24:53.452179 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f227308f-4d44-4197-9dfd-ddf690c0c0f9', 'name': 'network-vif-deleted', 'tag': 'cf2ca0eb-9e28-4a89-8062-525c1792d08a', 'status': 'completed', 'code': 200} Dec 14 03:24:53.495329 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:24:53.629872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:53.704613 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:24:53.733643 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:24:53.741730 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:24:53.742330 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:24:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:24:53.842129 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:24:54.001450 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ab13e0fb-7af5-41a6-ab19-42c61513e098 req-4f23f485-a0cf-4fbf-9041-10281996f0e3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/ports?device_id=f227308f-4d44-4197-9dfd-ddf690c0c0f9 HTTP/1.1" status: 200 len: 210 time: 0.0260248 Dec 14 03:24:54.043961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:24:54.068937 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9bb080c-ae09-4ee8-b8fb-f710a2c54e12 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:14:51Z', 'revision_number': 4, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '72b484c2-b432-4085-96b7-6249ec75de2d', 'name': '', 'network_id': '7e397d2e-d5ba-40c3-8051-57991a288ab3', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'mac_address': 'fa:16:3e:1f:39:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:47Z', 'updated_at': '2021-12-14T03:14:59Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'subnets': [{'id': 'cc81a563-179d-4cba-977d-84ceacabb0ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:24:54.272070 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a3fcd88-a5e2-4df9-8664-22f7fa60c7b9 None None] New status for floating IP 06546c06-fc07-462f-b88d-cb1be5de718e: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:24:54.603580 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.091571 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57608) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:24:55.142830 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.165921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.214692 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.217299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.218404 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /v2.0/security-groups/82422a55-c106-4735-9c53-08650620c7f6 HTTP/1.1" status: 204 len: 168 time: 0.1258442 Dec 14 03:24:55.221280 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57610) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:24:55.227918 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82422a55-c106-4735-9c53-08650620c7f6,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:55.234905 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.235304 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.235628 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.235881 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.api.v2.resource [None req-8737403d-1897-423a-819a-d929480ff5ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] show failed (client error): The resource could not be found. Dec 14 03:24:55.236005 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.236298 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.236680 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.236875 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8737403d-1897-423a-819a-d929480ff5ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /v2.0/security-groups/82422a55-c106-4735-9c53-08650620c7f6 HTTP/1.1" status: 404 len: 347 time: 0.0145884 Dec 14 03:24:55.236995 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.237586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.237907 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.238230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.238548 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.238867 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.239230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cee98ee4-def9-4043-8afd-cde5d867a70a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:24:55.240126 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57612) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:24:55.359273 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Deleting port 52462e29-485d-4a69-b335-297e5b5db116 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:24:55.360356 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.362718 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device cf2ca0eb-9e28-4a89-8062-525c1792d08a no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:24:55.381964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: cf2ca0eb-9e28-4a89-8062-525c1792d08a {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:24:55.382811 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device cf2ca0eb-9e28-4a89-8062-525c1792d08a not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:24:55.434147 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.434469 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.446042 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling delete_port for 52462e29-485d-4a69-b335-297e5b5db116 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:24:55.570594 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.596610 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Pushing event deleted for resources: {'Port': ['ID=52462e29-485d-4a69-b335-297e5b5db116,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:24:55.657980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.660715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:55.661850 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0c477607-ce15-48cf-bf84-2b2ba06fbd27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /v2.0/floatingips/06546c06-fc07-462f-b88d-cb1be5de718e HTTP/1.1" status: 204 len: 168 time: 0.4208536 Dec 14 03:24:55.803081 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:59.185821 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57640) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:24:59.611344 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:59.843758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Deleting port 72b484c2-b432-4085-96b7-6249ec75de2d {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:24:59.844093 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:59.918201 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] For port 72b484c2-b432-4085-96b7-6249ec75de2d, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=72b484c2-b432-4085-96b7-6249ec75de2d,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:24:59.918504 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:24:59.929701 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Calling delete_port for 72b484c2-b432-4085-96b7-6249ec75de2d owned by network:router_interface {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:25:00.102206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:00.134737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Pushing event deleted for resources: {'Port': ['ID=72b484c2-b432-4085-96b7-6249ec75de2d,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:00.303295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:00.510802 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Router 1730ffec-70d3-4fe6-b3d1-76f550a253ce has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:25:00.615832 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:25:00.621851 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-dcadc9d7-8e6d-4268-8a0c-63bd25eb5832 admin admin] 10.222.0.43 "PUT /v2.0/routers/1730ffec-70d3-4fe6-b3d1-76f550a253ce/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4350162 Dec 14 03:25:00.624387 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57644) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:00.625134 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Sync routers for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:25:00.635294 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:25:00.636196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:24:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:00.876287 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:25:01.005424 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.052182 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:25:00Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:01.077648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Checking router: 1730ffec-70d3-4fe6-b3d1-76f550a253ce for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:25:01.086156 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Routers {'1730ffec-70d3-4fe6-b3d1-76f550a253ce'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:25:01.086785 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:24:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:01.104251 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.155521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Deleting port 0b0ac22c-ca16-4003-a9db-fd8193f4582a {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:25:01.155774 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.187730 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] Set router 1730ffec-70d3-4fe6-b3d1-76f550a253ce gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:25:01.235905 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] For port 0b0ac22c-ca16-4003-a9db-fd8193f4582a, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=0b0ac22c-ca16-4003-a9db-fd8193f4582a,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:25:01.236273 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.248110 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Calling delete_port for 0b0ac22c-ca16-4003-a9db-fd8193f4582a owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:25:01.355682 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:25:00Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:01.385553 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bbd8b47-7b1c-4085-bdc8-936beddd22d7 None None] The sync data for ids ['1730ffec-70d3-4fe6-b3d1-76f550a253ce'] in dv-cinder-818037-8-iscsi is: [{'id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'name': 'tempest-AttachVolumeTestJSON-916264010-router', 'tenant_id': '11634c00674445cb81d9dabfbcc791a8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:33Z', 'updated_at': '2021-12-14T03:25:00Z', 'revision_number': 5, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'gw_port': {'id': '0b0ac22c-ca16-4003-a9db-fd8193f4582a', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:d4:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1730ffec-70d3-4fe6-b3d1-76f550a253ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:25:01.411328 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.438818 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Pushing event deleted for resources: {'Port': ['ID=0b0ac22c-ca16-4003-a9db-fd8193f4582a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:01.500638 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.586692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.588751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.628975 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.629482 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1730ffec-70d3-4fe6-b3d1-76f550a253ce {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:25:01.634877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.636014 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5b6670e9-4282-4727-b99e-4e684a9348de admin admin] 10.222.0.43 "DELETE /v2.0/routers/1730ffec-70d3-4fe6-b3d1-76f550a253ce HTTP/1.1" status: 204 len: 168 time: 1.0107157 Dec 14 03:25:01.638609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57646) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:01.682387 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Deleting subnet cc81a563-179d-4cba-977d-84ceacabb0ec {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:25:01.685409 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.721072 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.801684 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.855295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.880315 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc81a563-179d-4cba-977d-84ceacabb0ec,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:01.884414 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:01.887632 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-77b07118-d513-4944-8812-3050a3c65d46 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/cc81a563-179d-4cba-977d-84ceacabb0ec HTTP/1.1" status: 204 len: 168 time: 0.2480011 Dec 14 03:25:01.889992 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57648) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:01.894021 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b77d71c8-0c2c-444e-aa03-eddc5842b0a3 None None] Network 7e397d2e-d5ba-40c3-8051-57991a288ab3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:25:01.964108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.031875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Deleting port 87620883-93e1-4b22-b4ff-c8fabbab793b {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:25:02.032210 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.091565 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] For port 87620883-93e1-4b22-b4ff-c8fabbab793b, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=87620883-93e1-4b22-b4ff-c8fabbab793b,segment=NetworkSegment(a99fd986-ad0c-461f-859e-1ffa364c753d),segment_id=a99fd986-ad0c-461f-859e-1ffa364c753d)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:25:02.091925 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.104388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Calling delete_port for 87620883-93e1-4b22-b4ff-c8fabbab793b owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:25:02.182786 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.206458 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Pushing event deleted for resources: {'Port': ['ID=87620883-93e1-4b22-b4ff-c8fabbab793b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:02.209795 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] No DVR routers for this DVR port 87620883-93e1-4b22-b4ff-c8fabbab793b on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:25:02.278783 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.297989 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e397d2e-d5ba-40c3-8051-57991a288ab3']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:02.307252 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a99fd986-ad0c-461f-859e-1ffa364c753d') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:02.308451 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a99fd986-ad0c-461f-859e-1ffa364c753d') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:02.319150 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.332341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.338533 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Releasing vlan 263 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:25:02.338970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:25:02.340717 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:25:02.351431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0c9331f-482b-4af6-8dcd-fa2ec5d6619e None None] DHCP port deletion for 7e397d2e-d5ba-40c3-8051-57991a288ab3 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:25:02.400614 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.406023 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.409367 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] 10.222.0.43 "DELETE /v2.0/networks/7e397d2e-d5ba-40c3-8051-57991a288ab3 HTTP/1.1" status: 204 len: 168 time: 0.5179906 Dec 14 03:25:02.420691 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8867a5-c239-4d8f-8c2f-b2b070736759 admin admin] Pushing event deleted for resources: {'Network': ['ID=7e397d2e-d5ba-40c3-8051-57991a288ab3,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:02.530142 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57652) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:02.568885 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-ac286354-be3e-48a5-8807-30d905cbb9ec admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=11634c00674445cb81d9dabfbcc791a8&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0375175 Dec 14 03:25:02.571133 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57654) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:02.620524 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.641004 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.686918 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 0b0ac22c-ca16-4003-a9db-fd8193f4582a no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:25:02.695893 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.698736 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:02.700005 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/aea87a0e-e3e5-4701-a478-4c60cdb9ea1c HTTP/1.1" status: 204 len: 168 time: 0.1279914 Dec 14 03:25:02.709305 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe07aa6c-d56c-4972-b010-cdc9932c1b67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aea87a0e-e3e5-4701-a478-4c60cdb9ea1c,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:02.721762 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 0b0ac22c-ca16-4003-a9db-fd8193f4582a {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:25:02.722236 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 0b0ac22c-ca16-4003-a9db-fd8193f4582a not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:25:02.722665 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 72b484c2-b432-4085-96b7-6249ec75de2d no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:25:02.747384 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 72b484c2-b432-4085-96b7-6249ec75de2d {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:25:02.747750 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 72b484c2-b432-4085-96b7-6249ec75de2d not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:25:02.748143 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 87620883-93e1-4b22-b4ff-c8fabbab793b no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:25:02.766342 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 87620883-93e1-4b22-b4ff-c8fabbab793b {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:25:02.766689 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 87620883-93e1-4b22-b4ff-c8fabbab793b not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:25:04.336097 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57704) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:04.439099 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-081709c0-c045-4cba-ac78-10b04443133e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.510843 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-081709c0-c045-4cba-ac78-10b04443133e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.514254 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-081709c0-c045-4cba-ac78-10b04443133e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.550808 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-081709c0-c045-4cba-ac78-10b04443133e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=feb579fd6dde4869a7ad55192522ecd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2136405 Dec 14 03:25:04.552765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081709c0-c045-4cba-ac78-10b04443133e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4205a06-1b46-4b48-8c88-1df1b4fef9eb,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:04.554205 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57708) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:04.599765 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.620964 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.665528 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.668205 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:04.671691 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c4205a06-1b46-4b48-8c88-1df1b4fef9eb HTTP/1.1" status: 204 len: 168 time: 0.1142321 Dec 14 03:25:04.679468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aca973e-384c-4389-a952-8d545bb68ba1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4205a06-1b46-4b48-8c88-1df1b4fef9eb,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:04.919556 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57714) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:04.932453 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d302b96b-f909-45f2-9a27-096a4a688579 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.007296 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d302b96b-f909-45f2-9a27-096a4a688579 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.010907 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d302b96b-f909-45f2-9a27-096a4a688579 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.046959 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d302b96b-f909-45f2-9a27-096a4a688579 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebfbc530-9ed4-4bd5-8670-ec81a2d14757,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:05.051131 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d302b96b-f909-45f2-9a27-096a4a688579 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a20c08a5dfe146e18bb44cd6837eb8c1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1305437 Dec 14 03:25:05.053837 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57716) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:05.100657 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.120964 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.165682 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.168379 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.169495 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ebfbc530-9ed4-4bd5-8670-ec81a2d14757 HTTP/1.1" status: 204 len: 168 time: 0.1147470 Dec 14 03:25:05.176876 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7118439-b3ff-411e-b714-36282c9addaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebfbc530-9ed4-4bd5-8670-ec81a2d14757,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:05.806234 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57738) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:05.899083 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1351989714-network', 'tenant_id': 'cb592fad72af4d73aea8f53b672220da'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:25:05.920090 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Made reservation on behalf of cb592fad72af4d73aea8f53b672220da for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:25:05.922365 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:05.930863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.000327 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.003970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.030411 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 263} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:25:06.039551 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad3840fb-80f1-4a4f-940e-104f88896d63,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:06.045521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.045860 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Added segment f88790ff-0a51-41d5-8ea6-05d9ed0e6634 of type vlan for network 9ee37976-f1c5-4f90-b02b-559b8f237fb4 Dec 14 03:25:06.083833 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.108334 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.109253 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:06.109825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.158255 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.3508797 Dec 14 03:25:06.161155 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57744) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:06.166642 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Request body: {'subnet': {'network_id': '9ee37976-f1c5-4f90-b02b-559b8f237fb4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1351989714-subnet', 'tenant_id': 'cb592fad72af4d73aea8f53b672220da', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:25:06.171108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3649c7-4870-4c5d-ad81-183b710e9f1b admin admin] Pushing event updated for resources: {'Network': ['ID=9ee37976-f1c5-4f90-b02b-559b8f237fb4,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:06.181927 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 9ee37976-f1c5-4f90-b02b-559b8f237fb4 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:25:06.186567 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Made reservation on behalf of cb592fad72af4d73aea8f53b672220da for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:25:06.189030 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12477423'] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.352345 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2037184', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12477425'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.410905 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=437d13bc-34a9-4018-8715-eb958469cce9,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:06.416658 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Checking segment: {'id': 'f88790ff-0a51-41d5-8ea6-05d9ed0e6634', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '9ee37976-f1c5-4f90-b02b-559b8f237fb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:25:06.417161 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Network hostable DHCP agents. Network: 9ee37976-f1c5-4f90-b02b-559b8f237fb4, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:25:06.432938 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Network 9ee37976-f1c5-4f90-b02b-559b8f237fb4 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:25:06.440467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 9ee37976-f1c5-4f90-b02b-559b8f237fb4) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:25:06.445413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:06.446179 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.449245 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf8aa11a-a096-437e-9946-4cb5e191e384 None None] Network 9ee37976-f1c5-4f90-b02b-559b8f237fb4 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:25:06.461192 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6b717fe3-5da9-4f7c-8f2b-4553abdc89f7 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.2989233 Dec 14 03:25:06.546547 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d60bf92-ff1c-437e-8812-2813994cedea None None] Network 9ee37976-f1c5-4f90-b02b-559b8f237fb4 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:25:06.914771 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57760) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:06.919653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2046660232-network', 'tenant_id': '46fa4d088fd44cddac22eadcfbe3cbf5'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:25:06.939073 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Made reservation on behalf of 46fa4d088fd44cddac22eadcfbe3cbf5 for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:25:06.941181 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:06.949618 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.021269 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.025222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.052278 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 297} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:25:07.061751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e9e8eee-e639-43dc-a6d4-f5889633872d,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:07.066466 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.066808 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Added segment 0f542ef7-3b0f-4fc2-bbb7-e962e5ab6415 of type vlan for network 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 Dec 14 03:25:07.105192 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.130029 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.131100 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:07.131846 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.180431 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.2644691 Dec 14 03:25:07.183171 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57762) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:07.188146 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Request body: {'subnet': {'network_id': '2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2046660232-subnet', 'tenant_id': '46fa4d088fd44cddac22eadcfbe3cbf5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:25:07.193777 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0baac31c-9bb3-4b96-9c19-d710b04d415a admin admin] Pushing event updated for resources: {'Network': ['ID=2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:07.203711 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:25:07.208223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Made reservation on behalf of 46fa4d088fd44cddac22eadcfbe3cbf5 for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:25:07.211078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12477423'] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.370745 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2037184', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12477425'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.432569 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fbf9d033-8dd3-4399-ab1d-f35d47f38d3b,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:07.436784 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Checking segment: {'id': '0f542ef7-3b0f-4fc2-bbb7-e962e5ab6415', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 297, 'network_id': '2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:25:07.437140 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Network hostable DHCP agents. Network: 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:25:07.453570 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Network 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:25:07.462160 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:25:07.465962 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:07.466552 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.470666 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae59369d-d93d-4ba2-9a5b-a250c463d128 None None] Network 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:25:07.481681 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-86828e7b-7dcc-443c-9a59-46b099880777 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.2973428 Dec 14 03:25:07.567341 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a6f96e1-1bea-43a1-8d7a-f0b93ca18241 None None] Network 2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:25:07.593848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57766) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:07.638526 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Deleting subnet 437d13bc-34a9-4018-8715-eb958469cce9 {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:25:07.641840 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.675963 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.713473 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.764896 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.788534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=437d13bc-34a9-4018-8715-eb958469cce9,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:07.792374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.795503 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-505191e8-656f-4250-a094-bb2abfaa29f2 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/437d13bc-34a9-4018-8715-eb958469cce9 HTTP/1.1" status: 204 len: 168 time: 0.2005842 Dec 14 03:25:07.798008 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57768) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:07.861847 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.939769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.959330 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ee37976-f1c5-4f90-b02b-559b8f237fb4']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:07.968184 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f88790ff-0a51-41d5-8ea6-05d9ed0e6634') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:07.968409 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f88790ff-0a51-41d5-8ea6-05d9ed0e6634') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:07.977332 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.989900 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.996148 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Releasing vlan 263 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:25:07.996521 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:25:07.998098 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:25:08.049113 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.056594 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.059872 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] 10.222.0.43 "DELETE /v2.0/networks/9ee37976-f1c5-4f90-b02b-559b8f237fb4 HTTP/1.1" status: 204 len: 168 time: 0.2609372 Dec 14 03:25:08.062827 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57770) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:08.069185 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d740afce-e4b1-4b62-a38e-bdb7c2e12efe admin admin] Pushing event deleted for resources: {'Network': ['ID=9ee37976-f1c5-4f90-b02b-559b8f237fb4,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:08.106997 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Deleting subnet fbf9d033-8dd3-4399-ab1d-f35d47f38d3b {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:25:08.110094 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.147398 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.184781 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.235412 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.260142 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fbf9d033-8dd3-4399-ab1d-f35d47f38d3b,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:08.264506 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.267806 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3a4a6fdb-1a0f-456a-a5d8-4e01cd37cf79 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/fbf9d033-8dd3-4399-ab1d-f35d47f38d3b HTTP/1.1" status: 204 len: 168 time: 0.2038920 Dec 14 03:25:08.270267 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 57772) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:08.337937 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.415396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.434646 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:08.443499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0f542ef7-3b0f-4fc2-bbb7-e962e5ab6415') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:08.443811 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0f542ef7-3b0f-4fc2-bbb7-e962e5ab6415') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:08.456806 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.469904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.476692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Releasing vlan 297 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:25:08.477089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:25:08.478822 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:25:08.534013 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.539459 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.542613 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] 10.222.0.43 "DELETE /v2.0/networks/2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9 HTTP/1.1" status: 204 len: 168 time: 0.2714403 Dec 14 03:25:08.553125 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33056939-d04d-432a-b873-fe7a97478f43 admin admin] Pushing event deleted for resources: {'Network': ['ID=2a5b3e14-a83e-4a4f-83e7-c5566d4c93b9,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:08.697109 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57776) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:08.741346 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-500c2309-eee9-4654-99da-76e216e5a3f3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=cb592fad72af4d73aea8f53b672220da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0430765 Dec 14 03:25:08.744022 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57778) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:08.789348 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.809972 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.855184 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.857724 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:08.858979 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ad3840fb-80f1-4a4f-940e-104f88896d63 HTTP/1.1" status: 204 len: 168 time: 0.1140635 Dec 14 03:25:08.867078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d756ac-aa5b-492a-88ae-dbe67edac460 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad3840fb-80f1-4a4f-940e-104f88896d63,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:09.155934 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57784) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:09.193852 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7b518faa-fc73-4339-b25a-5fd0f7fe3b43 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=46fa4d088fd44cddac22eadcfbe3cbf5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0367718 Dec 14 03:25:09.196765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 57786) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:09.240295 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:09.261574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:09.307440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:09.310091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:09.311364 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6e9e8eee-e639-43dc-a6d4-f5889633872d HTTP/1.1" status: 204 len: 168 time: 0.1137118 Dec 14 03:25:09.318805 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b5d8a23-f1e2-4cd8-b066-0b6c6c3e55af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e9e8eee-e639-43dc-a6d4-f5889633872d,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:11.274989 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:19.689960 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2edd9443-90b6-4d1c-b9a6-7a77797940ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:21.885050 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-331ae7f2-040a-4dcf-a21e-fdd9f29506d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:23.611326 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:24.607136 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:25.798993 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:28.993556 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:25:41.292076 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:46.390033 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-6d4b7347-4d0b-44d5-9dc0-88bc1f0b70e5 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1272275 Dec 14 03:25:46.462534 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-446e5e65-4ecd-4c5f-95f0-ec6a1f6e3163 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:46.463970 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-446e5e65-4ecd-4c5f-95f0-ec6a1f6e3163 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 1098 time: 0.0379603 Dec 14 03:25:46.567272 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-545b964c-218c-4358-8f01-2547447eddf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:46.568666 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-545b964c-218c-4358-8f01-2547447eddf3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0835745 Dec 14 03:25:46.631983 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-c39de19a-281e-4c2f-848c-5415c6479d31 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 200 len: 1001 time: 0.0559351 Dec 14 03:25:46.684044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-61c99530-89f6-4393-ac68-97f46bd5fe37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:46.685468 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-61c99530-89f6-4393-ac68-97f46bd5fe37 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0454869 Dec 14 03:25:46.730332 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-908439fc-ecbd-4adf-8b70-daafd88e3855 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:46.731801 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-908439fc-ecbd-4adf-8b70-daafd88e3855 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0385747 Dec 14 03:25:46.818998 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-cf6b31c1-3b41-4ced-b4e8-d1174af70a78 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793662 Dec 14 03:25:46.909304 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6bcc788d-76b9-497c-9059-49f5b08a907b req-8f799446-3870-4472-88db-ecf602934771 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823104 Dec 14 03:25:49.690589 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-536ff236-52da-4396-b2af-c442aa1a1a4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:51.885534 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-14451c60-0e46-4076-9f25-cef89be4e2a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:52.561407 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 req-41333b7c-029d-4f82-bc19-ef803b9287af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:52.562868 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 req-41333b7c-029d-4f82-bc19-ef803b9287af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0478072 Dec 14 03:25:52.609854 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 req-018c4e31-b1d4-40bc-80a6-6c84f29b94f0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0408890 Dec 14 03:25:53.615865 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:53.728285 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15763f2-bf66-4515-830c-15bf7ebcab14 req-76a5be98-a29a-45b1-a2bd-e50066c7e0c0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:53.729723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a15763f2-bf66-4515-830c-15bf7ebcab14 req-76a5be98-a29a-45b1-a2bd-e50066c7e0c0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0469749 Dec 14 03:25:53.776178 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a15763f2-bf66-4515-830c-15bf7ebcab14 req-0c11549d-5f37-439c-b858-16d076081fd7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups?id=edd17fc9-b72c-450c-8a69-066d081a37b8&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0405700 Dec 14 03:25:54.326745 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-4740837a-c21a-4570-9fee-5d33701cb991 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:25:54.328248 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-4740837a-c21a-4570-9fee-5d33701cb991 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 947 time: 0.0499480 Dec 14 03:25:54.423381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Deleting port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:25:54.423758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.511192 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] For port 9eee83b0-b14c-403e-a6bd-7d2515f7e214, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=9eee83b0-b14c-403e-a6bd-7d2515f7e214,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:25:54.511560 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.591748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58202) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:54.612925 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.687433 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.687841 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.688156 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Floating IP c58214ba-c405-42fb-9d95-053336465a20 disassociated. External IP: 172.27.3.212, port: 9eee83b0-b14c-403e-a6bd-7d2515f7e214. Dec 14 03:25:54.688490 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling delete_port for 9eee83b0-b14c-403e-a6bd-7d2515f7e214 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:25:54.700431 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-15243e9d-23ed-4751-a190-b766e4e36655 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.777067 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-15243e9d-23ed-4751-a190-b766e4e36655 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.780925 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-15243e9d-23ed-4751-a190-b766e4e36655 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.817542 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:54.819791 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15243e9d-23ed-4751-a190-b766e4e36655 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ebe11bc-68e6-47bf-9c51-712431389829,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:54.829853 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-15243e9d-23ed-4751-a190-b766e4e36655 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8375ed2b4aac4c9b9683c5cbcededb21&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2364676 Dec 14 03:25:54.830091 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58208) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:54.856257 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'Port': ['ID=9eee83b0-b14c-403e-a6bd-7d2515f7e214,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:54.883624 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-49b8601e-fd2d-40bc-8521-1cdd2830570d req-f70bffb3-82f6-4987-b958-01bc846b1c32 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/ports?device_id=279d5888-562c-4c6a-b27c-3f8e84fd510f HTTP/1.1" status: 200 len: 210 time: 0.0331585 Dec 14 03:25:54.915631 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.915981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.916325 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.916666 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.917000 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.917331 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.917659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.917989 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.918312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.918636 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.918962 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.919312 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.919637 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:54.996444 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.027896 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.042628 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:25:55.114286 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.116865 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.118487 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7ebe11bc-68e6-47bf-9c51-712431389829 HTTP/1.1" status: 204 len: 168 time: 0.2866371 Dec 14 03:25:55.129700 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ea9f21-b69b-4a14-8c8f-4ee5e955078f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ebe11bc-68e6-47bf-9c51-712431389829,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:55.182739 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:25:55.196986 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:25:55.208296 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:25:55.208296 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:55.227681 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] No DVR routers for this DVR port 9eee83b0-b14c-403e-a6bd-7d2515f7e214 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:25:55.230338 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.234516 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8dea81c1-5373-4396-b3dd-7a5f24444c36 req-2d1c1edc-df98-45bd-b60c-893996d18322 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.20 "DELETE /v2.0/ports/9eee83b0-b14c-403e-a6bd-7d2515f7e214 HTTP/1.1" status: 204 len: 173 time: 0.8995719 Dec 14 03:25:55.234985 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-deleted', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:25:55.237737 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11d19987-80b5-4318-9fed-b6d0ffa0201b" -d '{"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-deleted", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:25:55.348234 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:25:55.461099 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58218) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:55.474547 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e35f537b-1098-4751-bdca-acd2af7f21ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.493971 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:25:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a8de3f6-d1af-4362-a62d-eed411efff44 x-openstack-request-id: req-8a8de3f6-d1af-4362-a62d-eed411efff44 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:25:55.494263 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-deleted", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:25:55.494516 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8a8de3f6-d1af-4362-a62d-eed411efff44 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:25:55.494908 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '279d5888-562c-4c6a-b27c-3f8e84fd510f', 'name': 'network-vif-deleted', 'tag': '9eee83b0-b14c-403e-a6bd-7d2515f7e214', 'status': 'completed', 'code': 200} Dec 14 03:25:55.552769 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e35f537b-1098-4751-bdca-acd2af7f21ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.557232 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-e35f537b-1098-4751-bdca-acd2af7f21ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.569531 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:55.594379 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e35f537b-1098-4751-bdca-acd2af7f21ea admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=30986e7ea7ed4be7b25f4f4596ac813b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1321993 Dec 14 03:25:55.595246 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35f537b-1098-4751-bdca-acd2af7f21ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c47306d-9e6d-4045-9ac8-71179a1778a4,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:55.597095 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58220) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:55.597973 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:25:55.607135 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:25:55.607747 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:55.645367 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.669046 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.719612 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.722862 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.726990 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2c47306d-9e6d-4045-9ac8-71179a1778a4 HTTP/1.1" status: 204 len: 168 time: 0.1258733 Dec 14 03:25:55.734347 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c47306d-9e6d-4045-9ac8-71179a1778a4,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:55.745042 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.745654 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.746156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.746706 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.747338 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.747866 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.748491 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.748990 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.749477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.750108 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.750849 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.758957 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.759695 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93143d7f-bb29-489a-ba7a-fe0c276e396e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:25:55.818470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:55.820607 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:25:55.971071 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58232) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:56.034223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.034469 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:25:56.061614 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.068669 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1ba152d-0178-4457-b80b-c34b3a376c1b None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:14:42Z', 'revision_number': 4, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb', 'name': '', 'network_id': '61e8c126-6b7d-4549-9293-90629e6175d3', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'mac_address': 'fa:16:3e:b3:2c:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:39Z', 'updated_at': '2021-12-14T03:14:53Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'subnets': [{'id': '8711f032-5b57-4823-aa19-b0e6030552b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:25:56.118010 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.120903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.122258 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /v2.0/security-groups/edd17fc9-b72c-450c-8a69-066d081a37b8 HTTP/1.1" status: 204 len: 168 time: 0.1495728 Dec 14 03:25:56.125006 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58240) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:56.135340 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7947b240-dd24-47ce-81c3-2897bd0ed583 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=edd17fc9-b72c-450c-8a69-066d081a37b8,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:56.143881 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.api.v2.resource [None req-3b283872-4cd0-4c74-9d05-aa477c409c26 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] show failed (client error): The resource could not be found. Dec 14 03:25:56.144904 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-3b283872-4cd0-4c74-9d05-aa477c409c26 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /v2.0/security-groups/edd17fc9-b72c-450c-8a69-066d081a37b8 HTTP/1.1" status: 404 len: 347 time: 0.0189102 Dec 14 03:25:56.148038 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58242) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:56.286304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Deleting port 74964162-5f0f-414f-bbec-13b180a53c9a {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:25:56.286650 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.343201 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fff8fff3-58ae-4a02-95ab-b6de7818883f None None] New status for floating IP c58214ba-c405-42fb-9d95-053336465a20: DOWN {{(pid=102573) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:25:56.374271 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.374603 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.393341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling delete_port for 74964162-5f0f-414f-bbec-13b180a53c9a owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:25:56.535451 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.561074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Pushing event deleted for resources: {'Port': ['ID=74964162-5f0f-414f-bbec-13b180a53c9a,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:56.622397 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.625114 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:56.626101 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-1f59ed78-a7b2-4ba6-9df2-95834333fac0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /v2.0/floatingips/c58214ba-c405-42fb-9d95-053336465a20 HTTP/1.1" status: 204 len: 168 time: 0.4768624 Dec 14 03:25:57.292355 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58276) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:57.392690 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-769104c2-bd52-4398-93e8-f4825da03897 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.463231 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-769104c2-bd52-4398-93e8-f4825da03897 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.466632 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-769104c2-bd52-4398-93e8-f4825da03897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.504599 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-769104c2-bd52-4398-93e8-f4825da03897 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fe136f2cb9924e8896ecbb6c0b6f5b62&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2111719 Dec 14 03:25:57.505451 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769104c2-bd52-4398-93e8-f4825da03897 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c959d86d-aeeb-4eb8-88f5-f5a89847b0ff,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:57.508005 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58280) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:57.555418 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.575502 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.621240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.623805 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.624918 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c959d86d-aeeb-4eb8-88f5-f5a89847b0ff HTTP/1.1" status: 204 len: 168 time: 0.1157589 Dec 14 03:25:57.632243 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027da08a-e45c-4edc-9d6f-849a371b4331 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c959d86d-aeeb-4eb8-88f5-f5a89847b0ff,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:57.695844 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:25:57.719504 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 9eee83b0-b14c-403e-a6bd-7d2515f7e214 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:25:57.719861 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 9eee83b0-b14c-403e-a6bd-7d2515f7e214 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:25:57.892615 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58294) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:57.905442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7efa8150-a072-471a-acb4-d3da072deb4a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.985828 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7efa8150-a072-471a-acb4-d3da072deb4a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:57.990000 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7efa8150-a072-471a-acb4-d3da072deb4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:58.027654 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7efa8150-a072-471a-acb4-d3da072deb4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72079741-d045-4f76-b6e9-1d42cfd0b81e,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:58.032880 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7efa8150-a072-471a-acb4-d3da072deb4a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ea5851e48f18404880c6c80712202c74&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1392376 Dec 14 03:25:58.035762 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58298) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:58.083306 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:58.104171 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:58.148640 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:58.151195 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:58.152308 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/72079741-d045-4f76-b6e9-1d42cfd0b81e HTTP/1.1" status: 204 len: 168 time: 0.1156807 Dec 14 03:25:58.159613 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956b7374-6f69-4809-856f-57c018d1adc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72079741-d045-4f76-b6e9-1d42cfd0b81e,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:25:59.069201 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58334) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:25:59.553201 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:59.807817 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Deleting port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:25:59.808156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:59.887455 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] For port 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:25:59.887747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:25:59.899783 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Calling delete_port for 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb owned by network:router_interface {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:00.070413 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:00.092106 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Pushing event deleted for resources: {'Port': ['ID=4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:00.257438 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:00.457021 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Router efa90d3f-db01-404e-ab49-7a4127455630 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:26:00.560609 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:26:00.565702 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-abf24e5b-7147-4c99-a470-07a43d99ede2 admin admin] 10.222.0.43 "PUT /v2.0/routers/efa90d3f-db01-404e-ab49-7a4127455630/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4953933 Dec 14 03:26:00.568549 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58354) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:00.570325 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Sync routers for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:26:00.579792 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:00.580410 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:00.671980 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:00.685321 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:00.869498 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:26:00Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:00.895553 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Checking router: efa90d3f-db01-404e-ab49-7a4127455630 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:26:00.905467 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Routers {'efa90d3f-db01-404e-ab49-7a4127455630'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:00.906098 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['efa90d3f-db01-404e-ab49-7a4127455630'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:01.016780 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] Set router efa90d3f-db01-404e-ab49-7a4127455630 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:01.049571 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.103347 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Deleting port 721bfbf0-cf5b-46fc-803a-1093edc88ca6 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:26:01.103771 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.203669 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] For port 721bfbf0-cf5b-46fc-803a-1093edc88ca6, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=721bfbf0-cf5b-46fc-803a-1093edc88ca6,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:01.204031 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.211330 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:26:00Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:01.217637 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Calling delete_port for 721bfbf0-cf5b-46fc-803a-1093edc88ca6 owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:01.238334 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc99dcf-fad7-4fe7-a0dc-9fbdf0a6666b None None] The sync data for ids ['efa90d3f-db01-404e-ab49-7a4127455630'] in dv-cinder-818037-8-iscsi is: [{'id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'name': 'tempest-AttachVolumeShelveTestJSON-1661608470-router', 'tenant_id': 'da53d564588b46b7bd658659f40a6ded', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:14:32Z', 'updated_at': '2021-12-14T03:26:00Z', 'revision_number': 5, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'gw_port': {'id': '721bfbf0-cf5b-46fc-803a-1093edc88ca6', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:22:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efa90d3f-db01-404e-ab49-7a4127455630', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:14:34Z', 'updated_at': '2021-12-14T03:14:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:26:01.379877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.403943 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Pushing event deleted for resources: {'Port': ['ID=721bfbf0-cf5b-46fc-803a-1093edc88ca6,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:01.462918 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.550981 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.552942 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.594468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.595254 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Fanout notify agent at l3_agent the message router_deleted on router efa90d3f-db01-404e-ab49-7a4127455630 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:26:01.599774 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.600895 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-780d86e7-93cc-4232-967f-755a0f0a3918 admin admin] 10.222.0.43 "DELETE /v2.0/routers/efa90d3f-db01-404e-ab49-7a4127455630 HTTP/1.1" status: 204 len: 168 time: 1.0313747 Dec 14 03:26:01.604332 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58366) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:01.892719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Deleting subnet 8711f032-5b57-4823-aa19-b0e6030552b6 {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:26:01.895829 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:01.927991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.004289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.053198 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.076200 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8711f032-5b57-4823-aa19-b0e6030552b6,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:02.082681 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.086771 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d07783a2-7940-4a8c-96d4-0732ff0db61e admin admin] 10.222.0.43 "DELETE /v2.0/subnets/8711f032-5b57-4823-aa19-b0e6030552b6 HTTP/1.1" status: 204 len: 168 time: 0.4811943 Dec 14 03:26:02.087926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbd2ef76-4acd-4967-a6dd-e53a38f54fcd None None] Network 61e8c126-6b7d-4549-9293-90629e6175d3 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:26:02.089027 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58368) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:02.154853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.213561 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Deleting port 06879854-6c57-41cd-aef1-64f16a79c337 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:26:02.213985 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.287028 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] For port 06879854-6c57-41cd-aef1-64f16a79c337, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=06879854-6c57-41cd-aef1-64f16a79c337,segment=NetworkSegment(1270198f-e0f2-4558-aaef-824767bb1c50),segment_id=1270198f-e0f2-4558-aaef-824767bb1c50)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:02.287442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.302214 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Calling delete_port for 06879854-6c57-41cd-aef1-64f16a79c337 owned by network:dhcp {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:02.393919 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.394690 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ffea953-fe13-458a-a8f5-14ea4fa1278d None None] DHCP port deletion for 61e8c126-6b7d-4549-9293-90629e6175d3 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:26:02.426946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] No DVR routers for this DVR port 06879854-6c57-41cd-aef1-64f16a79c337 on host dv-cinder-818037-8-iscsi {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:26:02.432102 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=06879854-6c57-41cd-aef1-64f16a79c337,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:02.501886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.527638 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61e8c126-6b7d-4549-9293-90629e6175d3']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:02.539222 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1270198f-e0f2-4558-aaef-824767bb1c50') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:02.539636 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1270198f-e0f2-4558-aaef-824767bb1c50') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:02.553468 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.568485 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.575906 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Releasing vlan 267 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:26:02.576211 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:26:02.578052 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:26:02.632979 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.638209 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.641593 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] 10.222.0.43 "DELETE /v2.0/networks/61e8c126-6b7d-4549-9293-90629e6175d3 HTTP/1.1" status: 204 len: 168 time: 0.5516558 Dec 14 03:26:02.653151 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c66c74c-ff41-427b-a6c2-8a696475b1c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=61e8c126-6b7d-4549-9293-90629e6175d3,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:02.722438 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:26:02.742917 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:26:02.743380 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 4994aa9e-0fa4-41a7-bbfb-f4cb6fd5b0eb not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:26:02.743869 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 06879854-6c57-41cd-aef1-64f16a79c337 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:26:02.762873 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 06879854-6c57-41cd-aef1-64f16a79c337 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:26:02.763221 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 06879854-6c57-41cd-aef1-64f16a79c337 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:26:02.763621 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 721bfbf0-cf5b-46fc-803a-1093edc88ca6 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:26:02.785752 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 721bfbf0-cf5b-46fc-803a-1093edc88ca6 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:26:02.786256 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 721bfbf0-cf5b-46fc-803a-1093edc88ca6 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:26:02.816290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58382) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:02.856465 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-71f2d41c-bf88-4364-8b76-1ae4b922590d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=da53d564588b46b7bd658659f40a6ded&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0387528 Dec 14 03:26:02.858685 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58384) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:02.904057 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.924152 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.970901 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.973456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:02.974552 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/88b11454-71c9-4384-aaac-cd4acf585726 HTTP/1.1" status: 204 len: 168 time: 0.1149435 Dec 14 03:26:02.981906 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee5a14b-8303-4e5e-afad-2fa3164f35c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88b11454-71c9-4384-aaac-cd4acf585726,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:04.550808 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58442) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:04.652363 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3b8fc61-5893-4c65-adc9-2a7cebea0a15 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.724694 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3b8fc61-5893-4c65-adc9-2a7cebea0a15 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.728908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3b8fc61-5893-4c65-adc9-2a7cebea0a15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.767003 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-c3b8fc61-5893-4c65-adc9-2a7cebea0a15 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0e39f713eeec4eb9b41fb33af74b076a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2150171 Dec 14 03:26:04.767796 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b8fc61-5893-4c65-adc9-2a7cebea0a15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42d685da-829b-490a-8a00-9b3689e41c23,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:04.769756 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58446) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:04.816632 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.837624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.880904 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.884085 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:04.885198 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/42d685da-829b-490a-8a00-9b3689e41c23 HTTP/1.1" status: 204 len: 168 time: 0.1144447 Dec 14 03:26:04.892452 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e9e9ec-f6cf-42af-bf72-c5c103e6f09b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42d685da-829b-490a-8a00-9b3689e41c23,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:05.136659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58456) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:05.149603 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c282c4cb-8df3-4722-a11d-ecb5c2859fb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.228890 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c282c4cb-8df3-4722-a11d-ecb5c2859fb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.238153 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c282c4cb-8df3-4722-a11d-ecb5c2859fb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.278232 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c282c4cb-8df3-4722-a11d-ecb5c2859fb6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bba373a03d334b16bc3ea9a6ee05e49a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1380966 Dec 14 03:26:05.278232 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c282c4cb-8df3-4722-a11d-ecb5c2859fb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=344f8edf-365b-4f85-be7b-a09b642593e3,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:05.279067 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58462) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:05.335400 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.356584 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.402907 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.405898 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:05.407063 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/344f8edf-365b-4f85-be7b-a09b642593e3 HTTP/1.1" status: 204 len: 168 time: 0.1269364 Dec 14 03:26:05.415613 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6903eac8-a432-42c6-b95e-61d6cb6a95ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=344f8edf-365b-4f85-be7b-a09b642593e3,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:05.992090 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:26:08.850941 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58538) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:08.952067 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3d07e37-3fe0-4b31-8d1f-c00b8cd5c81a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.023801 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3d07e37-3fe0-4b31-8d1f-c00b8cd5c81a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.028187 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-c3d07e37-3fe0-4b31-8d1f-c00b8cd5c81a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.065532 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-c3d07e37-3fe0-4b31-8d1f-c00b8cd5c81a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bff96c9404434d89a988bb218868370a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2133641 Dec 14 03:26:09.066404 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d07e37-3fe0-4b31-8d1f-c00b8cd5c81a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1275b89-892a-4449-aed5-c4a93dfc9a32,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:09.068944 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58542) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:09.117875 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.137842 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.183005 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.185617 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.186741 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e1275b89-892a-4449-aed5-c4a93dfc9a32 HTTP/1.1" status: 204 len: 168 time: 0.1175480 Dec 14 03:26:09.195779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5feb9d6-ebf0-4d0a-a504-173677cd82f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1275b89-892a-4449-aed5-c4a93dfc9a32,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:09.445828 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58554) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:09.460296 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f5e08f24-e1b9-4a50-96be-af469c0752d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.541199 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f5e08f24-e1b9-4a50-96be-af469c0752d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.545291 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f5e08f24-e1b9-4a50-96be-af469c0752d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.583980 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f5e08f24-e1b9-4a50-96be-af469c0752d9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=00817cd1621148ce9445098610c4094a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1361415 Dec 14 03:26:09.585129 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e08f24-e1b9-4a50-96be-af469c0752d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d844b1a-89e6-42aa-b27b-a3e69655bf17,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:09.586550 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58564) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:09.636685 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.658410 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.705863 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.708527 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:09.709674 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9d844b1a-89e6-42aa-b27b-a3e69655bf17 HTTP/1.1" status: 204 len: 168 time: 0.1214604 Dec 14 03:26:09.718388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67356f91-c0eb-4586-bd83-6727653db060 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d844b1a-89e6-42aa-b27b-a3e69655bf17,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:10.068812 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b942e53-fd3f-448f-b259-50730bfab9d5 req-00f75c21-8d89-4279-a10d-2ff4e779b4a6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:10.070357 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1b942e53-fd3f-448f-b259-50730bfab9d5 req-00f75c21-8d89-4279-a10d-2ff4e779b4a6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0539527 Dec 14 03:26:10.125896 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1b942e53-fd3f-448f-b259-50730bfab9d5 req-941a0125-110f-4528-91cb-70976e6c6f3e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474465 Dec 14 03:26:11.240830 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0042388-c90d-464c-b466-3f3b47ef26f5 req-ed40bbb0-2e87-4578-af1f-7f72ac2cc75b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:11.242319 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0042388-c90d-464c-b466-3f3b47ef26f5 req-ed40bbb0-2e87-4578-af1f-7f72ac2cc75b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0485375 Dec 14 03:26:11.293261 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0042388-c90d-464c-b466-3f3b47ef26f5 req-c65e15f6-8468-4f24-91e2-9b6af5b8f335 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444589 Dec 14 03:26:11.313867 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:11.684299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58650) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:11.791651 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-49c30bb8-c7c2-41f3-84ec-094382cb97de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:11.849633 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-28ff2b95-d970-490e-8058-75ebae9eca57 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:11.851309 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-28ff2b95-d970-490e-8058-75ebae9eca57 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 945 time: 0.0502119 Dec 14 03:26:11.868520 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-49c30bb8-c7c2-41f3-84ec-094382cb97de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:11.872511 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-49c30bb8-c7c2-41f3-84ec-094382cb97de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:11.913727 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-49c30bb8-c7c2-41f3-84ec-094382cb97de admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c6e097052e65432190be198786e1771d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2283165 Dec 14 03:26:11.916056 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58658) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:11.924555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c30bb8-c7c2-41f3-84ec-094382cb97de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04423285-9f34-444f-b27f-ae507e3cf342,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:11.948241 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:26:11.948586 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:11.976136 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.000333 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.052477 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] For port ee1b94f1-9b24-4f43-ae74-a354e91e38f1, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:12.052829 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.064089 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.067065 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.070600 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/04423285-9f34-444f-b27f-ae507e3cf342 HTTP/1.1" status: 204 len: 168 time: 0.1511114 Dec 14 03:26:12.081405 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a4a15e6-4dc1-4dba-a06f-90d94a2313fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04423285-9f34-444f-b27f-ae507e3cf342,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:12.229004 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.229367 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.229681 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 0420008b-d84b-485a-9af4-6526ba1176e5 disassociated. External IP: 172.27.3.120, port: ee1b94f1-9b24-4f43-ae74-a354e91e38f1. Dec 14 03:26:12.230030 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for ee1b94f1-9b24-4f43-ae74-a354e91e38f1 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:12.333883 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58670) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:12.348321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6247eca3-0fa0-4ba0-ae1f-c771472df814 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.364720 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.395053 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=ee1b94f1-9b24-4f43-ae74-a354e91e38f1,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:12.402946 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 req-f1c4a65a-5063-4bbe-8d52-1fab71521de2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0325494 Dec 14 03:26:12.461755 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6247eca3-0fa0-4ba0-ae1f-c771472df814 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.466020 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-6247eca3-0fa0-4ba0-ae1f-c771472df814 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.503873 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-6247eca3-0fa0-4ba0-ae1f-c771472df814 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fdc5b5d4131348daae6e7cda1fbf5100&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1689038 Dec 14 03:26:12.504818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6247eca3-0fa0-4ba0-ae1f-c771472df814 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51898c23-88e2-45cc-921a-91b42ae843ab,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:12.506416 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58672) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:12.517194 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:26:12.605908 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.661776 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.680507 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:26:12.690176 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:26:12.699724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:12.700345 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:12.731885 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] No DVR routers for this DVR port ee1b94f1-9b24-4f43-ae74-a354e91e38f1 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:26:12.734670 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.738329 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 req-e5f634e6-4106-4e54-a5ba-5fa6d560dcfd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "DELETE /v2.0/ports/ee1b94f1-9b24-4f43-ae74-a354e91e38f1 HTTP/1.1" status: 204 len: 173 time: 0.8801844 Dec 14 03:26:12.738787 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'name': 'network-vif-deleted', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:12.741086 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02e9f61c-0a56-4107-858b-8332487ea418" -d '{"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-deleted", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:12.761785 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.764430 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:12.765563 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/51898c23-88e2-45cc-921a-91b42ae843ab HTTP/1.1" status: 204 len: 168 time: 0.2565084 Dec 14 03:26:12.773597 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-256521ae-0d6b-4ba0-b919-e31433f2935f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51898c23-88e2-45cc-921a-91b42ae843ab,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:12.786501 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8fd11982-ecd0-421a-8199-6a3a4505b608 x-openstack-request-id: req-8fd11982-ecd0-421a-8199-6a3a4505b608 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:12.786793 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-deleted", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:12.787079 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8fd11982-ecd0-421a-8199-6a3a4505b608 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:12.787469 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76d36b1d-a395-46b5-b80d-9fa1871c0873', 'name': 'network-vif-deleted', 'tag': 'ee1b94f1-9b24-4f43-ae74-a354e91e38f1', 'status': 'completed', 'code': 200} Dec 14 03:26:12.859560 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:13.067786 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:13.093521 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:26:13.104159 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:13.104877 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:25:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:13.224472 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:13.429442 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:13.455219 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e20d46dd-300c-4005-9250-721ec244c309 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:26:13.524423 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5ff4773a-2951-41ab-8951-241bdeb5ec9c req-9b212e57-fc6a-42be-8095-4c6f614f623e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0273504 Dec 14 03:26:13.700435 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-058283f1-464d-44c9-aaf8-91e9b99c6531 None None] New status for floating IP 0420008b-d84b-485a-9af4-6526ba1176e5: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:26:14.619062 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9d365f8b-c311-4aaf-8981-61faf855c17f req-2be0da4e-a904-47e7-b700-185438978af6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0253980 Dec 14 03:26:15.713482 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-46637a41-5756-4fab-9bf7-22e5afec7980 req-4a9ae3fd-83ee-4256-8613-fa05e345d9cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0283554 Dec 14 03:26:16.680791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device ee1b94f1-9b24-4f43-ae74-a354e91e38f1 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:26:16.726547 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: ee1b94f1-9b24-4f43-ae74-a354e91e38f1 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:26:16.726811 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device ee1b94f1-9b24-4f43-ae74-a354e91e38f1 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:26:16.807141 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-683d23b2-9060-4236-93ec-8e7532863386 req-4347d247-d076-4e3f-88f9-4da1f30621ce tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=76d36b1d-a395-46b5-b80d-9fa1871c0873 HTTP/1.1" status: 200 len: 210 time: 0.0256495 Dec 14 03:26:18.065790 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-b8f4b1b0-cb7d-4b9d-9497-5765e8bd16f4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-201763541&fields=id&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 267 time: 0.0442407 Dec 14 03:26:18.168736 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-bfc62456-a8c3-454a-87a4-530c581ffbeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:18.170191 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-bfc62456-a8c3-454a-87a4-530c581ffbeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.0975075 Dec 14 03:26:18.185084 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-aec88f5b-548c-4555-9e3a-87e6414ac9dc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/quotas/d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 375 time: 0.0091908 Dec 14 03:26:18.237112 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-f3b34055-5cd9-4c9d-b8a7-51f89a525ba2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0468311 Dec 14 03:26:18.253884 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-3d2cf159-0d24-4615-8031-71055a8f5aaa service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:26:18.254830 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-3d2cf159-0d24-4615-8031-71055a8f5aaa service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050657 Dec 14 03:26:18.339663 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-9dbc9944-98bc-466b-8f3c-999d86838737 service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789695 Dec 14 03:26:18.433253 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-1fc70d11-de69-4ee0-a144-c6245b3dc6d7 service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876129 Dec 14 03:26:18.707400 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e33088d3-68ec-49f5-82e2-e7d61f87d7cf req-1bbac444-279b-4854-9bee-9fa0edc9c287 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 210 time: 0.0256763 Dec 14 03:26:18.987162 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58822) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:19.098779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9b674621-bfcb-4d45-9ccd-60b11f4a7199 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.175977 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9b674621-bfcb-4d45-9ccd-60b11f4a7199 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.179779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9b674621-bfcb-4d45-9ccd-60b11f4a7199 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.218720 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b674621-bfcb-4d45-9ccd-60b11f4a7199 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77629e44-1c3f-49e5-b986-71711ec9c6a8,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:19.223031 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9b674621-bfcb-4d45-9ccd-60b11f4a7199 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=76b0f7c6711343ae8b26e45a9e0a2ef9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2343907 Dec 14 03:26:19.225625 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58828) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:19.273649 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.294434 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.340427 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.342993 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.344174 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/77629e44-1c3f-49e5-b986-71711ec9c6a8 HTTP/1.1" status: 204 len: 168 time: 0.1175990 Dec 14 03:26:19.355067 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c00ef47f-be11-48af-97af-991d435a819f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77629e44-1c3f-49e5-b986-71711ec9c6a8,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:19.601026 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 58834) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:19.615554 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8d38ef67-0d5c-418d-aa66-bea1f5644c17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.692913 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b20a3b50-84ab-4709-9260-08e5bdccab6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.698830 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8d38ef67-0d5c-418d-aa66-bea1f5644c17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.703107 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8d38ef67-0d5c-418d-aa66-bea1f5644c17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.752867 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8d38ef67-0d5c-418d-aa66-bea1f5644c17 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3f40e149b1504c4b93abfa3b30175672&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1506562 Dec 14 03:26:19.755469 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58838) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:19.765165 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d38ef67-0d5c-418d-aa66-bea1f5644c17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19c6fa63-630f-4060-ba24-4ffa32574f0c,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:19.826575 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 req-3a59455f-fc8b-4f85-85fd-d55b0ed389ff tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 210 time: 0.0353563 Dec 14 03:26:19.850022 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.863189 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-7726dc6d-42ce-42e3-8738-4f919a1ea96a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:19.864621 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-7726dc6d-42ce-42e3-8738-4f919a1ea96a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.1272886 Dec 14 03:26:19.872848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.929241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.932070 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:19.935878 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/19c6fa63-630f-4060-ba24-4ffa32574f0c HTTP/1.1" status: 204 len: 168 time: 0.1793945 Dec 14 03:26:19.944167 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ccf28d-6158-46f9-8084-c4691700afb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19c6fa63-630f-4060-ba24-4ffa32574f0c,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:19.965201 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-09a56d24-5623-4005-98ba-89e495e40a51 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 379 time: 0.0641577 Dec 14 03:26:19.980456 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'port': {'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'admin_state_up': True, 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'security_groups': ['aa81265e-19a7-4c76-ae75-2b53568fe438']}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:20.097440 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Made reservation on behalf of d0c4dcf4957d42b896f04f682afeef7b for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:26:20.101187 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.192462 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58850) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:20.231557 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.20.0.4 (8f2d77d5-e58c-4a97-8899-5e1a2da29f69/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5/15eacb4a-a968-4c7a-8e62-e27f90bfd84e) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:26:20.310672 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e7bf4b0-87a1-48e8-8c6a-dc7abd999027 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.397751 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.400711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e7bf4b0-87a1-48e8-8c6a-dc7abd999027 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.408266 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7e7bf4b0-87a1-48e8-8c6a-dc7abd999027 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.440659 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.459007 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7e7bf4b0-87a1-48e8-8c6a-dc7abd999027 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=4057172f9d694e73b6ed7459c85ada30&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2653594 Dec 14 03:26:20.464466 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58862) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:20.486365 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7bf4b0-87a1-48e8-8c6a-dc7abd999027 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5732ebe4-09cf-4ffb-9140-379bccbab2de,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:20.502567 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:26:20.507952 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:26:20.514301 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:26:20.573330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:20.581396 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.608647 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.622076 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:20.623178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.649709 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-2b051e4b-cb8c-4833-96b5-6289282906d1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6775422 Dec 14 03:26:20.674255 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Request body: {'port': {'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:20.676534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.681776 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.686534 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5732ebe4-09cf-4ffb-9140-379bccbab2de HTTP/1.1" status: 204 len: 168 time: 0.2210860 Dec 14 03:26:20.696747 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-743ab37e-1589-4d63-a2be-a1c83e64c405 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5732ebe4-09cf-4ffb-9140-379bccbab2de,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:20.741391 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.865860 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-f88b458a-c781-4db7-83ad-e879c3a7024e None None] Provisioning complete for port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:26:20.866896 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f88b458a-c781-4db7-83ad-e879c3a7024e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:20.902288 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-f88b458a-c781-4db7-83ad-e879c3a7024e None None] Port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:26:20.990477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f req-9debe1fb-4824-4f6a-b830-1581a941f1ec tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.000102 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f req-9debe1fb-4824-4f6a-b830-1581a941f1ec tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 931 time: 0.0735879 Dec 14 03:26:21.050628 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f req-c6e9dadf-41e8-4ed9-b7ab-e6ae23f1d8a3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492151 Dec 14 03:26:21.054599 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15eacb4a-a968-4c7a-8e62-e27f90bfd84e {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:21.064970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.078820 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Transition to ACTIVE for port object 15eacb4a-a968-4c7a-8e62-e27f90bfd84e will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:26:21.082495 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.134096 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Pushing event updated for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:21.220214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Attempting to bind port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:26:21.220779 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Attempting to bind port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:26:21.221110 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Attempting to bind port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:21.225619 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:26:21.225988 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Attempting to bind port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:21.235468 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 26, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:26:21.235854 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:26:21.236274 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Bound using segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:26:21.236877 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Bound port: 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:26:21.237087 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.312383 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:26:21.321305 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:26:21.325945 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.365465 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.366086 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.367795 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] 10.222.0.20 "PUT /v2.0/ports/15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 1093 time: 0.7028899 Dec 14 03:26:21.368075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:21.370503 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-715258bd-f0e7-4713-8303-bd16345f58cd" -d '{"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:21.404358 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5ea537-49be-41d9-b3b0-4dfa10f07e1f service neutron] Pushing event updated for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:21.494307 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1020a324-a603-45d1-9640-e739c86ad5fe x-openstack-request-id: req-1020a324-a603-45d1-9640-e739c86ad5fe {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:21.494827 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:21.495171 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1020a324-a603-45d1-9640-e739c86ad5fe {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:21.495784 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'status': 'completed', 'code': 200} Dec 14 03:26:21.517556 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-4a4940af-6c6c-4f84-94c6-fc2d3122d41a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.519172 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-4a4940af-6c6c-4f84-94c6-fc2d3122d41a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1096 time: 0.0777657 Dec 14 03:26:21.569758 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-3e2775a4-b47d-449d-962d-5f5fc44ecf59 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 217 time: 0.0378010 Dec 14 03:26:21.626219 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-a56ccf77-b94e-44f2-b990-09d27113be76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.627727 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-a56ccf77-b94e-44f2-b990-09d27113be76 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0497987 Dec 14 03:26:21.677838 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499fc08-0f25-4026-924c-5309354dad4e req-3e08800c-751a-4307-a34d-28f7812fa5f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.679344 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-3e08800c-751a-4307-a34d-28f7812fa5f6 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442913 Dec 14 03:26:21.767431 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-0acdbff9-ff1b-43a4-8958-27d7e3c5e7ee service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798805 Dec 14 03:26:21.859854 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-5499fc08-0f25-4026-924c-5309354dad4e req-0d9e73e5-90b7-44a7-86dc-5539fe054e83 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856111 Dec 14 03:26:21.886873 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-70b4545b-880b-4292-86a7-246072cf4398 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:21.992212 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715258bd-f0e7-4713-8303-bd16345f58cd req-82edd04e-ff91-44da-b559-d1ee9809a7c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:21.994338 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-82edd04e-ff91-44da-b559-d1ee9809a7c5 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1096 time: 0.0423777 Dec 14 03:26:22.084653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715258bd-f0e7-4713-8303-bd16345f58cd req-5e1e38bb-5ef1-43c9-a425-9fb070532f9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:22.086110 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-5e1e38bb-5ef1-43c9-a425-9fb070532f9f service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0847931 Dec 14 03:26:22.136913 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-cc111068-ffa9-4722-9d2c-d1f85ecf9efe service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 217 time: 0.0423610 Dec 14 03:26:22.166890 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 req-34912d3f-ca9c-49e2-97c7-5753faf50ab0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:22.168468 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 req-34912d3f-ca9c-49e2-97c7-5753faf50ab0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0485554 Dec 14 03:26:22.190253 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715258bd-f0e7-4713-8303-bd16345f58cd req-6df73e1c-654c-4240-9757-26164d8a91fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:22.191799 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-6df73e1c-654c-4240-9757-26164d8a91fd service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0470700 Dec 14 03:26:22.218924 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 req-65767ded-26f1-413e-8857-666c1078c5d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443716 Dec 14 03:26:22.244235 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715258bd-f0e7-4713-8303-bd16345f58cd req-cff181eb-923d-4f32-bf6d-23146019f523 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:22.245813 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-cff181eb-923d-4f32-bf6d-23146019f523 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0470378 Dec 14 03:26:22.337998 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-5c5e5f9a-4cb5-4a37-bb76-62768bac624f service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848458 Dec 14 03:26:22.429431 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-ee2b109f-b1df-4222-affe-387d2a63398f service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841508 Dec 14 03:26:23.334364 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf83a2c-f949-416e-9fdc-7184beb593cc req-6bce8cfd-a7b7-4a66-b698-70e414201ead tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:23.335867 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dbf83a2c-f949-416e-9fdc-7184beb593cc req-6bce8cfd-a7b7-4a66-b698-70e414201ead tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0486467 Dec 14 03:26:23.387174 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-dbf83a2c-f949-416e-9fdc-7184beb593cc req-da591d4b-6791-4b44-ac96-d93d894027e2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453506 Dec 14 03:26:23.615720 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.422859 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 58994) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:24.508733 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75072a04-2268-4bab-b70f-c9c908951559 req-76482bf0-200a-48f3-a592-8f07b354cb58 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:24.510759 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75072a04-2268-4bab-b70f-c9c908951559 req-76482bf0-200a-48f3-a592-8f07b354cb58 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0495503 Dec 14 03:26:24.566280 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75072a04-2268-4bab-b70f-c9c908951559 req-2d9502af-5424-4e36-9dd2-1dffaf09d644 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477169 Dec 14 03:26:24.587195 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89e0f28b-c8dc-4d12-98d2-7752832ecdc4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.613961 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.668274 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89e0f28b-c8dc-4d12-98d2-7752832ecdc4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.674070 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-89e0f28b-c8dc-4d12-98d2-7752832ecdc4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.714221 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-89e0f28b-c8dc-4d12-98d2-7752832ecdc4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7713b95b2aef44ef856f9a6e25c88988&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2902453 Dec 14 03:26:24.715135 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e0f28b-c8dc-4d12-98d2-7752832ecdc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30e721f7-78f9-47b2-b1d5-29b875bfdf5f,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:24.717075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59000) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:24.776851 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.798470 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.844674 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.847399 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:24.848531 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/30e721f7-78f9-47b2-b1d5-29b875bfdf5f HTTP/1.1" status: 204 len: 168 time: 0.1303198 Dec 14 03:26:24.856188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305e26ec-c7f2-4b19-9ec4-1aad24fbffc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30e721f7-78f9-47b2-b1d5-29b875bfdf5f,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:25.457404 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59034) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:25.549894 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1855013388-network', 'tenant_id': '78c0550396bb4156a986650fecac5f28'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:25.569991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Made reservation on behalf of 78c0550396bb4156a986650fecac5f28 for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:26:25.572820 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.580891 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.683559 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.687856 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.708937 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 291} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:26:25.717644 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce60486a-2686-4df0-82ff-258896df7849 req-db18c864-9472-47d7-aed3-aee25b67cb6a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:25.719131 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce60486a-2686-4df0-82ff-258896df7849 req-db18c864-9472-47d7-aed3-aee25b67cb6a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0815966 Dec 14 03:26:25.742450 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.742804 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Added segment 70f42285-8687-411c-9329-dc4b2583537e of type vlan for network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 Dec 14 03:26:25.750071 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=069e4661-5e85-4226-86e1-4c9fa6f22dd6,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:25.803097 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.813024 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.819853 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce60486a-2686-4df0-82ff-258896df7849 req-cf2e9879-352e-448b-83bb-f3a5a2e93b0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0942035 Dec 14 03:26:25.841839 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.842769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:25.843405 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:25.901383 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4428315 Dec 14 03:26:25.904418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59040) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:25.906683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a23fc6-0958-46a2-861c-18b968734d02 admin admin] Pushing event updated for resources: {'Network': ['ID=4bbf6845-f34a-4527-8c1c-a97ce74db8b8,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:25.909354 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Request body: {'subnet': {'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1855013388-subnet', 'tenant_id': '78c0550396bb4156a986650fecac5f28', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:25.917154 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:26:25.930167 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Made reservation on behalf of 78c0550396bb4156a986650fecac5f28 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:26:25.932581 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8547576'] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:26.094474 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12248346', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8547558'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:26.142128 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Pushing event updated for resources: {'Subnet': ['ID=a6c074a3-5bd9-40d4-851f-ebde92b04ca9,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:26.156481 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Checking segment: {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:26:26.156840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Network hostable DHCP agents. Network: 4bbf6845-f34a-4527-8c1c-a97ce74db8b8, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:26:26.172804 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:26:26.180667 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 4bbf6845-f34a-4527-8c1c-a97ce74db8b8) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:26:26.185063 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:26.185652 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:26.190585 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8d8ae57-badf-44a4-aab5-ed48167db713 None None] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:26:26.201293 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-454cbf87-c39b-4272-9b3e-efc2a32a884c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.2957637 Dec 14 03:26:26.294698 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8915c9c4-4e4f-41d6-b260-bcefcfd752d2 None None] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:26:26.932824 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b req-f3d0902d-c178-4dd7-a0e0-a74b96da4228 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:26.934165 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b req-f3d0902d-c178-4dd7-a0e0-a74b96da4228 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0470390 Dec 14 03:26:26.981071 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b req-163b6180-efd4-47eb-99e6-84aad77182fb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409760 Dec 14 03:26:27.957534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5ec0ca9e-0ad8-42a4-938e-399001b95c69 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:27.958969 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5ec0ca9e-0ad8-42a4-938e-399001b95c69 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 809 time: 0.1010671 Dec 14 03:26:27.973238 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-05236692-9551-4880-a991-9f76cfca2756 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/quotas/78c0550396bb4156a986650fecac5f28 HTTP/1.1" status: 200 len: 375 time: 0.0085115 Dec 14 03:26:28.004798 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-8bac86f6-7194-43a1-ad70-50aaef88f977 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0264673 Dec 14 03:26:28.137370 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace req-add8cc56-38d1-49ee-b923-200af25452c5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:28.138819 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace req-add8cc56-38d1-49ee-b923-200af25452c5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.0817125 Dec 14 03:26:28.140694 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-6dbd2ee4-c84d-481a-9603-26fdbef27ce6 service neutron] 10.222.0.43 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291277 Dec 14 03:26:28.236063 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace req-7f68fccf-ccde-4e4e-ae5f-32115a53ae57 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0912325 Dec 14 03:26:28.267253 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-cf8b402d-b354-4fcb-a1cd-dd18854f1872 service neutron] 10.222.0.43 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1166596 Dec 14 03:26:28.419559 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bf03b2db-59e8-4f30-9e2b-f1f7428775e7 req-4120dc4b-77af-4376-90a0-4e26542eae68 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 210 time: 0.0263464 Dec 14 03:26:29.113519 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59120) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:29.214663 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-34b4537f-6082-4bfc-9e16-d10a87034d9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.292871 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-34b4537f-6082-4bfc-9e16-d10a87034d9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.297022 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-34b4537f-6082-4bfc-9e16-d10a87034d9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.357573 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-34b4537f-6082-4bfc-9e16-d10a87034d9d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=91749ecdde8e40149e586e80f10bcc8f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2429790 Dec 14 03:26:29.361807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59126) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:29.378118 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b4537f-6082-4bfc-9e16-d10a87034d9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=403cff9f-40f4-47b8-9e09-7cee90ce96ad,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:29.398927 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-6790d310-ae87-4949-879d-218b79ebfe92 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:29.402219 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-6790d310-ae87-4949-879d-218b79ebfe92 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 809 time: 0.1101227 Dec 14 03:26:29.414819 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d req-ead29125-ffe8-46d8-a7ae-b45552270ce3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:29.416892 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d req-ead29125-ffe8-46d8-a7ae-b45552270ce3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.1089144 Dec 14 03:26:29.428720 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Request body: {'port': {'device_id': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8', 'admin_state_up': True, 'tenant_id': '78c0550396bb4156a986650fecac5f28'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:29.446575 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.483153 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.501505 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d req-dc3abe38-a90b-4bdc-bd3e-bb12bc6c1a8c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0781031 Dec 14 03:26:29.541299 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 req-c1cc20e3-9016-4cac-bd75-a831eae52ef2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 210 time: 0.0346522 Dec 14 03:26:29.544894 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Made reservation on behalf of 78c0550396bb4156a986650fecac5f28 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:26:29.548459 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.568006 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.568006 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.568325 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/403cff9f-40f4-47b8-9e09-7cee90ce96ad HTTP/1.1" status: 204 len: 168 time: 0.2043498 Dec 14 03:26:29.576241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbd1688-6d9f-4238-b0f3-06925b6c797c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=403cff9f-40f4-47b8-9e09-7cee90ce96ad,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:29.683749 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Allocated IP 172.20.0.8 (4bbf6845-f34a-4527-8c1c-a97ce74db8b8/a6c074a3-5bd9-40d4-851f-ebde92b04ca9/4540549e-8d25-4a77-b531-a8cc8a115578) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:26:29.831308 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.835780 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59138) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:29.848677 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0727e283-f404-45ae-9503-1ff3296f9558 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.865602 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.913453 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:26:29.916529 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:26:29.918963 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:26:29.924507 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0727e283-f404-45ae-9503-1ff3296f9558 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.928167 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0727e283-f404-45ae-9503-1ff3296f9558 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.951949 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Pushing event updated for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:29.970711 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-0727e283-f404-45ae-9503-1ff3296f9558 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c6d68715f382424992958eff49682d0e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1314688 Dec 14 03:26:29.970711 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0727e283-f404-45ae-9503-1ff3296f9558 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=310ca880-0a52-43a2-96b1-c38aa941fe48,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:29.972545 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59140) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:29.974597 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:29.975264 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:29.991709 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-5661ad72-13b0-4b44-866f-997f83dfb992 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5673883 Dec 14 03:26:30.020606 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.040907 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.074758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Request body: {'port': {'device_id': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:30.086816 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.089557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.090688 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/310ca880-0a52-43a2-96b1-c38aa941fe48 HTTP/1.1" status: 204 len: 168 time: 0.1172416 Dec 14 03:26:30.098701 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f5c8fb4-26a1-42c0-8f24-266c93368e1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=310ca880-0a52-43a2-96b1-c38aa941fe48,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:30.129704 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.419459 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59146) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:30.433533 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0667ac95-783a-4b2e-bd5a-a57b761309b5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.510430 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0667ac95-783a-4b2e-bd5a-a57b761309b5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.515913 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-0667ac95-783a-4b2e-bd5a-a57b761309b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.553807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0667ac95-783a-4b2e-bd5a-a57b761309b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c55c95ce-2274-43c4-b493-79e43bc0b56e,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:30.558310 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-0667ac95-783a-4b2e-bd5a-a57b761309b5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b852077b70604a0e8c91b9a4545d710b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1377146 Dec 14 03:26:30.563490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59150) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:30.669640 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.703279 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383c20d3-2435-4dd1-ae37-0cce36861e5a req-e8d15e1f-f020-4ca8-975b-26d48320055a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:30.704762 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-383c20d3-2435-4dd1-ae37-0cce36861e5a req-e8d15e1f-f020-4ca8-975b-26d48320055a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 943 time: 0.1129172 Dec 14 03:26:30.707825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4540549e-8d25-4a77-b531-a8cc8a115578 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:30.708826 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 15eacb4a-a968-4c7a-8e62-e27f90bfd84e details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:26:30.710748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.716338 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.729119 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Transition to ACTIVE for port object 4540549e-8d25-4a77-b531-a8cc8a115578 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:26:30.733620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.735953 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6aa9575-8265-480b-ae56-603605b579cf req-fbd19131-0925-4a52-8821-08cc04b2c174 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:30.737696 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6aa9575-8265-480b-ae56-603605b579cf req-fbd19131-0925-4a52-8821-08cc04b2c174 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 931 time: 0.1113083 Dec 14 03:26:30.792847 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Pushing event updated for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:30.808486 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:30.820461 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 257, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:26:30.826657 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-383c20d3-2435-4dd1-ae37-0cce36861e5a req-a4c7557e-2279-4538-9471-95ed901cf3b6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1121650 Dec 14 03:26:30.865447 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6aa9575-8265-480b-ae56-603605b579cf req-b24c8d85-b380-4d99-bfe5-c6963340101f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069095 Dec 14 03:26:30.866233 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.874182 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.876795 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.877929 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c55c95ce-2274-43c4-b493-79e43bc0b56e HTTP/1.1" status: 204 len: 168 time: 0.3134711 Dec 14 03:26:30.880341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Attempting to bind port 4540549e-8d25-4a77-b531-a8cc8a115578 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:26:30.882579 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Attempting to bind port 4540549e-8d25-4a77-b531-a8cc8a115578 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:26:30.883616 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15eacb4a-a968-4c7a-8e62-e27f90bfd84e {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:30.883987 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Attempting to bind port 4540549e-8d25-4a77-b531-a8cc8a115578 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:30.886453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df34fe2f-8764-4e17-a814-fa567248f89a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c55c95ce-2274-43c4-b493-79e43bc0b56e,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:30.893758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Port 4540549e-8d25-4a77-b531-a8cc8a115578 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:26:30.894416 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Attempting to bind port 4540549e-8d25-4a77-b531-a8cc8a115578 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:30.900516 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 26, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:26:30.901150 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Checking segment: {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:26:30.901698 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Bound using segment: {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:26:30.901957 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Bound port: 4540549e-8d25-4a77-b531-a8cc8a115578, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:26:30.902310 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.907914 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:30.918135 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:30.968819 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:30.972743 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:26:30.976255 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.976420 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4540549e-8d25-4a77-b531-a8cc8a115578,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:26:30.977071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.977513 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.977936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.978347 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.978774 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.979302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.979655 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.979976 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.980388 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.980679 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.980964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.981455 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:30.983754 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:31.022313 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.022931 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:31.024339 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] 10.222.0.20 "PUT /v2.0/ports/4540549e-8d25-4a77-b531-a8cc8a115578 HTTP/1.1" status: 200 len: 1093 time: 0.9543083 Dec 14 03:26:31.025388 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:31.027693 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4" -d '{"events": [{"name": "network-changed", "server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:31.065060 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20dcaa7-832a-4153-b799-08ed5bb3cd01 service neutron] Pushing event updated for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:31.070174 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f83c568-09f5-4202-85a9-2fcc5dd5927f x-openstack-request-id: req-4f83c568-09f5-4202-85a9-2fcc5dd5927f {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:31.070454 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:31.070705 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4f83c568-09f5-4202-85a9-2fcc5dd5927f {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:31.075151 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578', 'status': 'completed', 'code': 200} Dec 14 03:26:31.147242 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-4e945132-3d72-4e9e-b868-b668db0fcdc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.148752 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-4e945132-3d72-4e9e-b868-b668db0fcdc6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 1096 time: 0.0431602 Dec 14 03:26:31.204153 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-2efc346a-8ef0-411d-95b6-6fa7d149ff91 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4540549e-8d25-4a77-b531-a8cc8a115578 HTTP/1.1" status: 200 len: 217 time: 0.0403564 Dec 14 03:26:31.256834 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-54a94d58-0b88-45c6-aa40-a03cc0e00b3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.258483 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-54a94d58-0b88-45c6-aa40-a03cc0e00b3c service neutron] 10.222.0.20 "GET /v2.0/subnets?id=a6c074a3-5bd9-40d4-851f-ebde92b04ca9 HTTP/1.1" status: 200 len: 849 time: 0.0447805 Dec 14 03:26:31.290804 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-d97c95cd-0095-4233-934c-42d2fd75dc71 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244927 Dec 14 03:26:31.331807 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['15eacb4a-a968-4c7a-8e62-e27f90bfd84e'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:26:31.381766 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-4f13f865-d520-4d0c-9a31-4e26ecda0d50 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838027 Dec 14 03:26:31.471325 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a req-80c9ea81-8316-4bc8-b618-701251da3976 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822954 Dec 14 03:26:31.599618 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-89dc6bd9-31f9-4fe8-b199-65a3910111ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.601092 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-89dc6bd9-31f9-4fe8-b199-65a3910111ed service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 1096 time: 0.0436773 Dec 14 03:26:31.690299 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-1d53bd5f-8bf3-4779-9fc0-bfa726a09b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.691787 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-1d53bd5f-8bf3-4779-9fc0-bfa726a09b35 service neutron] 10.222.0.20 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 910 time: 0.0823395 Dec 14 03:26:31.732187 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-8d2e04b3-115d-47fd-9619-42da5cefca4c service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4540549e-8d25-4a77-b531-a8cc8a115578 HTTP/1.1" status: 200 len: 217 time: 0.0332484 Dec 14 03:26:31.783640 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-377c552f-eefe-4ce4-a746-8f8d03cbc631 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.785056 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-377c552f-eefe-4ce4-a746-8f8d03cbc631 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=a6c074a3-5bd9-40d4-851f-ebde92b04ca9 HTTP/1.1" status: 200 len: 849 time: 0.0459673 Dec 14 03:26:31.814899 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-1ebea0dc-832d-4721-890a-6d2cd26b5871 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0227342 Dec 14 03:26:31.902954 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4a5ea094-7d4c-4f59-91d7-2b23dedc7bc5 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802429 Dec 14 03:26:31.995314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 req-9faf8bf9-9023-4d24-b874-49ed4cfc32f9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:31.996704 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 req-9faf8bf9-9023-4d24-b874-49ed4cfc32f9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 944 time: 0.0825658 Dec 14 03:26:31.996917 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-1d660955-b46d-4d2d-9051-9a90c56d3b5e service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851696 Dec 14 03:26:32.004478 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a47219-503d-4861-b273-d5ae36cc62ce req-54c48209-3fdb-4600-831b-95b233d30d37 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:32.005820 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-92a47219-503d-4861-b273-d5ae36cc62ce req-54c48209-3fdb-4600-831b-95b233d30d37 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 943 time: 0.0660601 Dec 14 03:26:32.079497 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 req-d3760280-b0e4-4a30-ab14-22453d36b93b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0727360 Dec 14 03:26:32.086787 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-92a47219-503d-4861-b273-d5ae36cc62ce req-e00f9ee1-3206-4dfa-be84-2d30b2832586 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737779 Dec 14 03:26:32.706765 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 15eacb4a-a968-4c7a-8e62-e27f90bfd84e up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:26:32.754602 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:26:32.758234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:26:32.758598 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:32.835308 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:32.856668 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:32.859121 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9" -d '{"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-plugged", "status": "completed", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:32.873897 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:32.877298 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:32.923620 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:33.063678 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cf382fe-3aa8-4b95-992b-dafc37deedca x-openstack-request-id: req-1cf382fe-3aa8-4b95-992b-dafc37deedca {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:33.063976 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-plugged", "status": "completed", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:33.064234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1cf382fe-3aa8-4b95-992b-dafc37deedca {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:33.064629 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'code': 200} Dec 14 03:26:33.223082 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9079d2-1885-4cd6-b044-2fb01ccff321 req-02e3336c-d7e8-4023-bb21-b87bb8bf4868 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:33.224490 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce9079d2-1885-4cd6-b044-2fb01ccff321 req-02e3336c-d7e8-4023-bb21-b87bb8bf4868 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0784414 Dec 14 03:26:33.232738 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72252d08-c0f3-4112-83d6-bb37d31ef860 req-880cb058-6cc9-4e00-ae74-4ee06b643310 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:33.234137 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72252d08-c0f3-4112-83d6-bb37d31ef860 req-880cb058-6cc9-4e00-ae74-4ee06b643310 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 943 time: 0.0778606 Dec 14 03:26:33.307636 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ce9079d2-1885-4cd6-b044-2fb01ccff321 req-79656565-dfc9-4c1d-a189-e7c0e7865e61 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0725379 Dec 14 03:26:33.310855 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-72252d08-c0f3-4112-83d6-bb37d31ef860 req-104eea54-e2ca-4557-b1b3-c238ac3fedb9 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698450 Dec 14 03:26:33.311222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee8162dc-7bf3-46b6-a70c-2060a9990d32 req-464a2b04-e2ec-46ad-ba11-ef1eb57e6615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:33.312688 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ee8162dc-7bf3-46b6-a70c-2060a9990d32 req-464a2b04-e2ec-46ad-ba11-ef1eb57e6615 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0390198 Dec 14 03:26:33.359272 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-ee8162dc-7bf3-46b6-a70c-2060a9990d32 req-ae134963-ef14-4cba-a6ab-326026f7e927 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388322 Dec 14 03:26:34.451707 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631be585-847e-4ba6-94df-d3b25faab20d req-77e55f41-2fdd-42c4-bac2-4faf5e919956 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:34.453191 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-631be585-847e-4ba6-94df-d3b25faab20d req-77e55f41-2fdd-42c4-bac2-4faf5e919956 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0780637 Dec 14 03:26:34.461058 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c399722-829b-4228-b67c-551b32bc4cc5 req-4c8727a5-acd9-425b-96cd-5646296c12a9 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:34.462927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c399722-829b-4228-b67c-551b32bc4cc5 req-4c8727a5-acd9-425b-96cd-5646296c12a9 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 943 time: 0.0788143 Dec 14 03:26:34.535860 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-631be585-847e-4ba6-94df-d3b25faab20d req-4b606b41-e319-4d93-b7e2-c3e30aa2d812 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0719898 Dec 14 03:26:34.539028 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8c399722-829b-4228-b67c-551b32bc4cc5 req-e2448f08-ce58-465f-b553-61e62dfc7639 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694711 Dec 14 03:26:34.720738 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4540549e-8d25-4a77-b531-a8cc8a115578 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:26:34.818003 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4540549e-8d25-4a77-b531-a8cc8a115578,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:34.830494 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '4540549e-8d25-4a77-b531-a8cc8a115578', 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8', 'port_id': '4540549e-8d25-4a77-b531-a8cc8a115578', 'mac_address': 'fa:16:3e:1d:80:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 291, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6c074a3-5bd9-40d4-851f-ebde92b04ca9', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:26:34.866444 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:34.879946 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4540549e-8d25-4a77-b531-a8cc8a115578 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:34.902798 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4540549e-8d25-4a77-b531-a8cc8a115578,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:34.906408 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:34.951529 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:35.312895 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['4540549e-8d25-4a77-b531-a8cc8a115578'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:26:35.676447 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f95883f-e56e-4379-8a62-b32ea79ee171 req-1def5c52-b05f-486f-b54f-ac1c74f2b785 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:35.677889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4f95883f-e56e-4379-8a62-b32ea79ee171 req-1def5c52-b05f-486f-b54f-ac1c74f2b785 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0765679 Dec 14 03:26:35.685544 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4309ec-7142-4968-803b-dc38c59508e7 req-d409e6a4-86b5-4acd-bc30-1d14347dc6c7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:35.686859 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d4309ec-7142-4968-803b-dc38c59508e7 req-d409e6a4-86b5-4acd-bc30-1d14347dc6c7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 944 time: 0.0767183 Dec 14 03:26:35.758022 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4f95883f-e56e-4379-8a62-b32ea79ee171 req-fc056356-bd1c-4e78-919b-45fe71525c35 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0702026 Dec 14 03:26:35.761884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d4309ec-7142-4968-803b-dc38c59508e7 req-c238719c-30a6-48b6-99fb-fc8e279b938a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686395 Dec 14 03:26:35.871673 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c12e63-5234-488d-9f2e-692be6769787 req-da95fd2b-ca24-4531-b3b1-450e1a068c23 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:35.873023 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-37c12e63-5234-488d-9f2e-692be6769787 req-da95fd2b-ca24-4531-b3b1-450e1a068c23 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0500500 Dec 14 03:26:35.919796 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-37c12e63-5234-488d-9f2e-692be6769787 req-d17fe69a-0c1d-43a0-852d-fe19a018041a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408752 Dec 14 03:26:35.941598 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59180) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:35.983464 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1783711-c5fa-45e9-a607-e70256287f41 tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:35.984976 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-e1783711-c5fa-45e9-a607-e70256287f41 tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1093 time: 0.0424402 Dec 14 03:26:35.987904 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59182) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:26:35.992050 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address': '172.20.0.4'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:36.014575 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.105832 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.207100 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.27.3.58 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/87f623f2-ca5e-4ed5-831b-315db2b717a3) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:26:36.302341 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.334693 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.374483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:26:36.377272 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:26:36.380691 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:26:36.402662 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=87f623f2-ca5e-4ed5-831b-315db2b717a3,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:36.720674 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.734073 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4540549e-8d25-4a77-b531-a8cc8a115578 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:26:36.780655 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 4540549e-8d25-4a77-b531-a8cc8a115578 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:26:36.786071 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 4540549e-8d25-4a77-b531-a8cc8a115578 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:26:36.786523 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.788699 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.865124 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.887470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:36.889713 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ddaa299-524e-4edb-acb7-4e53aa7e7764" -d '{"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-plugged", "status": "completed", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:36.910275 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4540549e-8d25-4a77-b531-a8cc8a115578,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:36.916247 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:36.940204 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a x-openstack-request-id: req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:36.940497 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-plugged", "status": "completed", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:36.940757 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:36.941152 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578', 'code': 200} Dec 14 03:26:36.968371 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:37.148886 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c68c9b1-4219-42e9-8aaa-74de333b12b4 req-82691d89-2e9d-4a03-9f45-e82f689c05c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:37.150921 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8c68c9b1-4219-42e9-8aaa-74de333b12b4 req-82691d89-2e9d-4a03-9f45-e82f689c05c7 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 1098 time: 0.0446362 Dec 14 03:26:37.167464 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e523c9-88ad-4150-953f-29d6415cf9ea req-fce43c78-639f-4d81-876b-d0608f42a259 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:37.168838 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76e523c9-88ad-4150-953f-29d6415cf9ea req-fce43c78-639f-4d81-876b-d0608f42a259 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 944 time: 0.3368614 Dec 14 03:26:37.195624 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-8c68c9b1-4219-42e9-8aaa-74de333b12b4 req-c72d0d86-6e55-445c-8fab-c7f2078ec587 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369732 Dec 14 03:26:37.240898 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:37.245532 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76e523c9-88ad-4150-953f-29d6415cf9ea req-17a4e7dc-c55a-4c51-9e73-b9d42749ab02 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688608 Dec 14 03:26:37.246472 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:37.312914 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=87f623f2-ca5e-4ed5-831b-315db2b717a3,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:37.324327 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:37.417274 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 9b9cdfa4-2674-4a49-b8ef-6ad469016b79 associated. External IP: 172.27.3.58, port: 15eacb4a-a968-4c7a-8e62-e27f90bfd84e. Dec 14 03:26:37.615120 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:26:37.719957 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:26:37.730101 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:26:37.738025 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:37.740643 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:37.741269 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:26:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:37.764158 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-ad14c2b4-ab19-4b2c-8b1b-0f6d435972e7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7752545 Dec 14 03:26:37.764733 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:37.766987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-778d602b-45d9-4812-8f65-0140eef585cb" -d '{"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:37.801937 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e x-openstack-request-id: req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:37.802227 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:37.802485 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:37.802884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'status': 'completed', 'code': 200} Dec 14 03:26:37.846115 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:37.900573 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778d602b-45d9-4812-8f65-0140eef585cb req-ba6fd009-656e-4fc0-96c3-2171e87c9582 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:37.901965 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-ba6fd009-656e-4fc0-96c3-2171e87c9582 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0400474 Dec 14 03:26:37.992467 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778d602b-45d9-4812-8f65-0140eef585cb req-03a48fa0-61a0-4bb8-9dc2-5e4085b20566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:37.994479 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-03a48fa0-61a0-4bb8-9dc2-5e4085b20566 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0855627 Dec 14 03:26:38.059445 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-b70aab81-6521-40ae-bf02-f7da42185c10 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 998 time: 0.0568342 Dec 14 03:26:38.066487 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:36Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:38.092053 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:26:38.100058 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:26:38.100662 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:26:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:38.118771 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778d602b-45d9-4812-8f65-0140eef585cb req-aa7deb3b-7232-4e7f-9930-1c12ea30d2b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:38.120245 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-aa7deb3b-7232-4e7f-9930-1c12ea30d2b9 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0434723 Dec 14 03:26:38.169546 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778d602b-45d9-4812-8f65-0140eef585cb req-c1486ee4-0a5e-4a13-8f59-5c31b1b0a564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:38.170939 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-c1486ee4-0a5e-4a13-8f59-5c31b1b0a564 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427566 Dec 14 03:26:38.203164 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:26:38.258496 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-a69d6c04-b9b4-463d-9f22-411fbc568f2c service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797167 Dec 14 03:26:38.357296 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-1a89d4eb-828e-4593-ad3e-df2f0049ed5c service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884984 Dec 14 03:26:38.371822 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 req-d13f9d9c-5980-4360-b660-30494bac97ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:38.373400 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 req-d13f9d9c-5980-4360-b660-30494bac97ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 945 time: 0.0583665 Dec 14 03:26:38.423354 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 req-dedf47ef-90c9-453c-bb11-55b6de7ff89c tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432038 Dec 14 03:26:38.429489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:36Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:26:38.466178 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46e02700-8781-40b1-b18f-8592aa4d4cb3 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:36Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:26:38.657983 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5ba7e17-2700-44bd-9b9b-a96579bc980c None None] New status for floating IP 9b9cdfa4-2674-4a49-b8ef-6ad469016b79: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:26:39.541120 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 req-bae9c67d-4b3a-404f-bfe1-93122178cfad tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:39.542572 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 req-bae9c67d-4b3a-404f-bfe1-93122178cfad tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 945 time: 0.0474555 Dec 14 03:26:39.588727 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 req-afd243f2-28c8-486b-8704-bf0fdfc6905a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402060 Dec 14 03:26:40.291839 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bf0c2-460f-4ffb-b8a3-44862cc97908 req-eb6b70dd-6028-459b-bd0c-1dbe93d5a93e tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:40.293261 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-716bf0c2-460f-4ffb-b8a3-44862cc97908 req-eb6b70dd-6028-459b-bd0c-1dbe93d5a93e tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 945 time: 0.0501089 Dec 14 03:26:40.339125 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-716bf0c2-460f-4ffb-b8a3-44862cc97908 req-02f49e25-dc2a-4256-8e2f-d24cef0a6328 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397205 Dec 14 03:26:41.321648 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:41.453373 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c6909a-d6bb-4093-a789-9757381c0b61 req-2be7bf78-22e4-4e32-82bc-9d30218a503a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:41.454805 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-59c6909a-d6bb-4093-a789-9757381c0b61 req-2be7bf78-22e4-4e32-82bc-9d30218a503a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 945 time: 0.0476203 Dec 14 03:26:41.500309 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-59c6909a-d6bb-4093-a789-9757381c0b61 req-9a8540ff-f66e-45d5-8510-9effd5b7d98a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396104 Dec 14 03:26:41.880715 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-758942ac-15e1-486d-b642-c9b46a1d0b6a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:41.882151 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-758942ac-15e1-486d-b642-c9b46a1d0b6a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 945 time: 0.0487349 Dec 14 03:26:41.968048 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Deleting port 4540549e-8d25-4a77-b531-a8cc8a115578 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:26:41.968313 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:42.057226 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] For port 4540549e-8d25-4a77-b531-a8cc8a115578, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=4540549e-8d25-4a77-b531-a8cc8a115578,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:42.057589 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:42.069154 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling delete_port for 4540549e-8d25-4a77-b531-a8cc8a115578 owned by compute:nova {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:42.197247 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:42.226844 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Pushing event deleted for resources: {'Port': ['ID=4540549e-8d25-4a77-b531-a8cc8a115578,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:42.232434 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['4540549e-8d25-4a77-b531-a8cc8a115578'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:26:42.264890 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] No DVR routers for this DVR port 4540549e-8d25-4a77-b531-a8cc8a115578 on host hv-cinder-81803 {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:26:42.267265 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:42.270603 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 req-d29602e2-8822-4d9b-8769-40f3d704adb2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "DELETE /v2.0/ports/4540549e-8d25-4a77-b531-a8cc8a115578 HTTP/1.1" status: 204 len: 173 time: 0.3822973 Dec 14 03:26:42.271070 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'name': 'network-vif-deleted', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:42.273296 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8686e2fb-a695-42d2-a2ac-40de828c7979" -d '{"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-deleted", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:42.311973 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dde13be3-89c9-470a-8fff-a4d1a151555d x-openstack-request-id: req-dde13be3-89c9-470a-8fff-a4d1a151555d {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:42.312292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-deleted", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:42.312552 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-dde13be3-89c9-470a-8fff-a4d1a151555d {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:42.312983 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '095e4cbb-3731-4cf1-85e3-8473d80de6bb', 'name': 'network-vif-deleted', 'tag': '4540549e-8d25-4a77-b531-a8cc8a115578', 'status': 'completed', 'code': 200} Dec 14 03:26:42.602257 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 req-60a20ea8-688a-493a-8266-a60951990c05 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=095e4cbb-3731-4cf1-85e3-8473d80de6bb HTTP/1.1" status: 200 len: 210 time: 0.0245416 Dec 14 03:26:42.990882 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:26:43.903856 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-af96612e-92e6-4a1a-b474-1833a5164321 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:43.905183 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-af96612e-92e6-4a1a-b474-1833a5164321 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 809 time: 0.1000073 Dec 14 03:26:43.919891 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-0f382ca3-c2ab-4033-a84d-8d673c5c9a13 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/quotas/78c0550396bb4156a986650fecac5f28 HTTP/1.1" status: 200 len: 375 time: 0.0090516 Dec 14 03:26:43.950170 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-a3d95d4c-e78e-46b7-a9dd-48d5a2445ffd tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0251684 Dec 14 03:26:44.048403 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-0465692f-741c-49e7-881f-83137503abfa service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102571) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:26:44.049373 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-0465692f-741c-49e7-881f-83137503abfa service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0927379 Dec 14 03:26:44.137060 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-64050c25-e48e-45d4-9ab7-026955c0d769 service neutron] 10.222.0.43 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814464 Dec 14 03:26:44.221611 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-1bd61f2b-6adb-407a-bad2-fc7f41a377cd service neutron] 10.222.0.43 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0785551 Dec 14 03:26:44.373445 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-139cf96c-934a-484e-85ab-da24851c2b80 req-8f8ebc22-5a3c-46d4-a3f3-3ae317ffdc56 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 210 time: 0.0266500 Dec 14 03:26:45.374089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-c2ef79be-f391-4c72-9480-f31e93ac76ee tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:45.375601 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-c2ef79be-f391-4c72-9480-f31e93ac76ee tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 809 time: 0.1059852 Dec 14 03:26:45.398252 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Request body: {'port': {'device_id': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8', 'admin_state_up': True, 'tenant_id': '78c0550396bb4156a986650fecac5f28'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:45.477172 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 req-9077d754-8ce9-4b72-99d3-0596e22c171f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 210 time: 0.0250604 Dec 14 03:26:45.507295 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Made reservation on behalf of 78c0550396bb4156a986650fecac5f28 for: {'port': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:26:45.511321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:45.632815 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Allocated IP 172.20.0.8 (4bbf6845-f34a-4527-8c1c-a97ce74db8b8/a6c074a3-5bd9-40d4-851f-ebde92b04ca9/25dd1574-96e1-476d-8ff3-adcbac643dd9) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:26:45.775015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:45.807448 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:45.850213 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:26:45.853233 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:26:45.856745 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:26:45.863093 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Pushing event updated for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:45.907320 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:45.907849 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:45.922586 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-b8e732e8-7911-40c9-9ffe-123ee088cf87 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5284421 Dec 14 03:26:45.944206 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Request body: {'port': {'device_id': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:26:46.002311 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.246706 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 25dd1574-96e1-476d-8ff3-adcbac643dd9 {{(pid=102572) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:46.253776 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.265043 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.provisioning_blocks [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Transition to ACTIVE for port object 25dd1574-96e1-476d-8ff3-adcbac643dd9 will not be triggered until provisioned by entity L2. {{(pid=102572) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:26:46.268602 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.332766 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Pushing event updated for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:46.382831 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Attempting to bind port 25dd1574-96e1-476d-8ff3-adcbac643dd9 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:26:46.383521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Attempting to bind port 25dd1574-96e1-476d-8ff3-adcbac643dd9 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:26:46.383521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Attempting to bind port 25dd1574-96e1-476d-8ff3-adcbac643dd9 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:46.387687 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Port 25dd1574-96e1-476d-8ff3-adcbac643dd9 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:26:46.388001 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Attempting to bind port 25dd1574-96e1-476d-8ff3-adcbac643dd9 on network 4bbf6845-f34a-4527-8c1c-a97ce74db8b8 {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:26:46.392646 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 26, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:26:46.392972 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Checking segment: {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:26:46.393341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Bound using segment: {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'} {{(pid=102572) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:26:46.393755 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.managers [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Bound port: 25dd1574-96e1-476d-8ff3-adcbac643dd9, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '70f42285-8687-411c-9329-dc4b2583537e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8'}}] {{(pid=102572) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:26:46.394096 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.454818 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, cleared binding levels {{(pid=102572) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:26:46.457732 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102572) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:26:46.461917 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.492044 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:46.492983 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:46.494411 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] 10.222.0.20 "PUT /v2.0/ports/25dd1574-96e1-476d-8ff3-adcbac643dd9 HTTP/1.1" status: 200 len: 1093 time: 0.5541158 Dec 14 03:26:46.498683 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:46.500899 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdcc1aa8-0416-4d81-a63b-e091773c0b93" -d '{"events": [{"name": "network-changed", "server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:46.528979 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb280b0-1208-4c04-85d2-da1508b9517a service neutron] Pushing event updated for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=3']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:46.544083 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f3acece-e1c3-4000-bc86-2ba12822fc1e x-openstack-request-id: req-3f3acece-e1c3-4000-bc86-2ba12822fc1e {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:46.544378 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:46.544922 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-3f3acece-e1c3-4000-bc86-2ba12822fc1e {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:46.545046 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9', 'status': 'completed', 'code': 200} Dec 14 03:26:46.603231 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-9d6e264e-f78d-4257-8069-7d2e8595fae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:46.605390 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-9d6e264e-f78d-4257-8069-7d2e8595fae6 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 1096 time: 0.0410867 Dec 14 03:26:46.606734 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca req-07b0b613-19a6-46e7-b9ed-a89abd45c739 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:46.608223 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca req-07b0b613-19a6-46e7-b9ed-a89abd45c739 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 943 time: 0.0520918 Dec 14 03:26:46.656243 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca req-d29466a6-e802-4a2e-83d9-33e9631f259d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417473 Dec 14 03:26:46.659096 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-90df49a1-80b1-40c8-9920-fee96985c8f8 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9 HTTP/1.1" status: 200 len: 217 time: 0.0393221 Dec 14 03:26:46.707850 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-943f3891-4a01-4c42-ae93-6a188377d516 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:46.709266 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-943f3891-4a01-4c42-ae93-6a188377d516 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=a6c074a3-5bd9-40d4-851f-ebde92b04ca9 HTTP/1.1" status: 200 len: 849 time: 0.0423846 Dec 14 03:26:46.740209 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-0eab768e-e2e8-46a8-a80c-bdd01c0b4b92 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234318 Dec 14 03:26:46.782957 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4540549e-8d25-4a77-b531-a8cc8a115578 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:26:46.810089 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 4540549e-8d25-4a77-b531-a8cc8a115578 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:26:46.810542 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 4540549e-8d25-4a77-b531-a8cc8a115578 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:26:46.831331 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-aa79652d-ed34-4078-8668-fbdd38a2b054 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826836 Dec 14 03:26:46.917149 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-6b850429-b3aa-4170-809c-be3a262d8c0d req-fb4a6b18-0226-43f9-8443-45ab6eaca32b service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0785601 Dec 14 03:26:47.066197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-5a149b1f-cc40-44f8-88bf-5754fb162c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.067685 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-5a149b1f-cc40-44f8-88bf-5754fb162c7d service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=78c0550396bb4156a986650fecac5f28&device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 1096 time: 0.0443840 Dec 14 03:26:47.158290 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-c0076ff3-91cb-4383-a216-1e1fdd8973b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.159752 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-c0076ff3-91cb-4383-a216-1e1fdd8973b9 service neutron] 10.222.0.20 "GET /v2.0/networks?id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 200 len: 910 time: 0.0847089 Dec 14 03:26:47.201445 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-0016fffc-c904-435c-b97e-fed5361b8b64 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9 HTTP/1.1" status: 200 len: 217 time: 0.0322301 Dec 14 03:26:47.252432 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-59587dad-b1cc-447f-a813-7247bd7fca68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.253852 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-59587dad-b1cc-447f-a813-7247bd7fca68 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=a6c074a3-5bd9-40d4-851f-ebde92b04ca9 HTTP/1.1" status: 200 len: 849 time: 0.0452828 Dec 14 03:26:47.283907 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-cfab3982-65b4-4d2c-8178-505e4c0b01d2 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=4bbf6845-f34a-4527-8c1c-a97ce74db8b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232084 Dec 14 03:26:47.347062 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-47eabb91-74a2-495a-88c6-9d9f15dd666d service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0374162 Dec 14 03:26:47.370050 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-1a106f69-379a-46e7-9357-9cb1d3010602 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787954 Dec 14 03:26:47.441200 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43771836-44d8-4e26-bb18-fd95892e3756 req-27e03a4c-1c97-4653-8c51-8ca51e152973 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.442665 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-27e03a4c-1c97-4653-8c51-8ca51e152973 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0398862 Dec 14 03:26:47.464811 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-79af97af-b1cc-46bc-9a54-aa31615ddf71 service neutron] 10.222.0.20 "GET /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871623 Dec 14 03:26:47.548259 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43771836-44d8-4e26-bb18-fd95892e3756 req-cc491a18-15e8-4d74-a2af-3ec7cd25a571 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.549691 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-cc491a18-15e8-4d74-a2af-3ec7cd25a571 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0865960 Dec 14 03:26:47.617692 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-8c25e9c6-0b9e-4b4c-bb5f-fd266724619b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 1000 time: 0.0558572 Dec 14 03:26:47.672737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43771836-44d8-4e26-bb18-fd95892e3756 req-3563d395-7a9c-4bc3-b639-893c360bc42e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.674158 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-3563d395-7a9c-4bc3-b639-893c360bc42e service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0465758 Dec 14 03:26:47.721574 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43771836-44d8-4e26-bb18-fd95892e3756 req-73752c33-6dd5-4654-b889-8e63aae634f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.723090 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-73752c33-6dd5-4654-b889-8e63aae634f3 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411732 Dec 14 03:26:47.827126 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 req-ccb74126-7bfe-4202-a5af-4ee68013b3c3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:47.828585 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 req-ccb74126-7bfe-4202-a5af-4ee68013b3c3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 943 time: 0.1042676 Dec 14 03:26:47.858420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-cc1eb503-1d5f-463f-adf2-bae0afa3579f service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262670 Dec 14 03:26:47.923825 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 req-f74c499a-c011-425d-bc32-dcc9218b7646 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875673 Dec 14 03:26:47.961601 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-43771836-44d8-4e26-bb18-fd95892e3756 req-bed0fbd5-30d0-4687-a171-46a5ce91a774 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926428 Dec 14 03:26:49.038494 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf49ce39-72eb-47bd-af45-03d3ec042e8a req-6a2b7644-c919-45b3-bed2-56fe05b87a3a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:49.039961 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf49ce39-72eb-47bd-af45-03d3ec042e8a req-6a2b7644-c919-45b3-bed2-56fe05b87a3a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 943 time: 0.0506554 Dec 14 03:26:49.085387 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf49ce39-72eb-47bd-af45-03d3ec042e8a req-0868c38f-1566-419c-8bcd-adf476832874 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389395 Dec 14 03:26:49.694246 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f960def8-6475-4bee-b828-51d30fd47bc3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:50.196987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 req-0a48762e-9d87-4f7a-a72a-2aab7a659296 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:50.198994 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 req-0a48762e-9d87-4f7a-a72a-2aab7a659296 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 943 time: 0.0463598 Dec 14 03:26:50.245198 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 req-803e1bb7-7d04-406e-83c8-ab6278e3153b tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403225 Dec 14 03:26:50.823667 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 25dd1574-96e1-476d-8ff3-adcbac643dd9 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:26:50.913751 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:50.925147 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': '25dd1574-96e1-476d-8ff3-adcbac643dd9', 'network_id': '4bbf6845-f34a-4527-8c1c-a97ce74db8b8', 'port_id': '25dd1574-96e1-476d-8ff3-adcbac643dd9', 'mac_address': 'fa:16:3e:60:ae:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 291, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a6c074a3-5bd9-40d4-851f-ebde92b04ca9', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:26:50.963959 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:50.976323 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 25dd1574-96e1-476d-8ff3-adcbac643dd9 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:26:50.995758 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:50.999639 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:51.044642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:51.359164 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 req-f4bddfa4-451e-402b-846b-f936fd3f062f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:51.360622 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 req-f4bddfa4-451e-402b-846b-f936fd3f062f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 944 time: 0.0498850 Dec 14 03:26:51.395631 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['25dd1574-96e1-476d-8ff3-adcbac643dd9'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:26:51.408122 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 req-35f43c61-6937-4477-b42a-6a4f87fa95e6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413811 Dec 14 03:26:51.888686 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1d6bd661-6246-42d3-b047-fe7ab5675e8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:52.520864 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 req-425c0482-c525-468e-a5ab-09a78f13ee78 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:52.522297 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 req-425c0482-c525-468e-a5ab-09a78f13ee78 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 944 time: 0.0473888 Dec 14 03:26:52.567705 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 req-393a4e68-6a87-465e-b949-de1ac223148e tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396438 Dec 14 03:26:52.843259 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 25dd1574-96e1-476d-8ff3-adcbac643dd9 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:26:52.889716 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port 25dd1574-96e1-476d-8ff3-adcbac643dd9 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:26:52.893207 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port 25dd1574-96e1-476d-8ff3-adcbac643dd9 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:26:52.893578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:52.970503 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:52.992380 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:52.995034 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dceeabdb-da46-40ee-9077-79d879039ef2" -d '{"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-plugged", "status": "completed", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:53.007898 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:53.011704 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:53.036442 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e x-openstack-request-id: req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:53.036728 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-plugged", "status": "completed", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:53.036980 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:53.037363 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9', 'code': 200} Dec 14 03:26:53.062082 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:53.248741 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88308de-bfbc-4c39-b7aa-88ad2029231c req-8b3a377d-8487-4df3-b59b-0c5b9b19cb34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:53.250073 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a88308de-bfbc-4c39-b7aa-88ad2029231c req-8b3a377d-8487-4df3-b59b-0c5b9b19cb34 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 1098 time: 0.0380704 Dec 14 03:26:53.297088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a88308de-bfbc-4c39-b7aa-88ad2029231c req-a348db3b-df28-4e08-b69c-596cbbf45575 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398932 Dec 14 03:26:53.620202 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:53.681639 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c566888-9141-4047-96ae-d590aa40e117 req-33044efa-3619-4fa6-9f3b-1fe5c7d9c89f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:53.683104 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7c566888-9141-4047-96ae-d590aa40e117 req-33044efa-3619-4fa6-9f3b-1fe5c7d9c89f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 945 time: 0.0474155 Dec 14 03:26:53.729118 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7c566888-9141-4047-96ae-d590aa40e117 req-339119f4-065e-45ac-aae8-af78ce5916f6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395200 Dec 14 03:26:54.618046 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:54.842321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d84a5b-ffbc-4445-989e-7af7ef78d062 req-e21e3df3-c9e0-41cb-9548-98bd4179d50b tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:54.843792 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00d84a5b-ffbc-4445-989e-7af7ef78d062 req-e21e3df3-c9e0-41cb-9548-98bd4179d50b tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 945 time: 0.0474005 Dec 14 03:26:54.889118 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-00d84a5b-ffbc-4445-989e-7af7ef78d062 req-88d9efc7-eea1-4160-9c7a-023883bf5310 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393643 Dec 14 03:26:55.603609 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 req-de4e6d5d-b3f5-43bf-a581-0fc7ed71cb43 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:55.605205 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 req-de4e6d5d-b3f5-43bf-a581-0fc7ed71cb43 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 945 time: 0.0502260 Dec 14 03:26:55.652004 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 req-28c5d41d-8df4-4df4-a329-55820ecb2e5c tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407178 Dec 14 03:26:55.804976 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:56.765716 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 req-14cd2541-4150-45b7-98b3-0d3fb51bdfe5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:56.767174 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 req-14cd2541-4150-45b7-98b3-0d3fb51bdfe5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 945 time: 0.0471642 Dec 14 03:26:56.813209 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 req-f97f536e-f37e-4cd7-bf34-e181ae4f58dc tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/security-groups?id=069e4661-5e85-4226-86e1-4c9fa6f22dd6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400753 Dec 14 03:26:57.228841 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-f62cdab2-3d08-4a59-bb7b-75835a0b6c63 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:26:57.230237 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-f62cdab2-3d08-4a59-bb7b-75835a0b6c63 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 945 time: 0.0464790 Dec 14 03:26:57.319035 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Deleting port 25dd1574-96e1-476d-8ff3-adcbac643dd9 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:26:57.319395 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:57.405122 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] For port 25dd1574-96e1-476d-8ff3-adcbac643dd9, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=25dd1574-96e1-476d-8ff3-adcbac643dd9,segment=NetworkSegment(70f42285-8687-411c-9329-dc4b2583537e),segment_id=70f42285-8687-411c-9329-dc4b2583537e)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:26:57.405482 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:57.417584 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling delete_port for 25dd1574-96e1-476d-8ff3-adcbac643dd9 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:26:57.542696 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:57.568481 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Pushing event deleted for resources: {'Port': ['ID=25dd1574-96e1-476d-8ff3-adcbac643dd9,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:26:57.577936 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.578289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.578584 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['25dd1574-96e1-476d-8ff3-adcbac643dd9'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:26:57.579095 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.579095 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.579296 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.579622 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.580220 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.580314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.580567 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.580890 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.581211 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.581533 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.581853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:26:57.624182 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] No DVR routers for this DVR port 25dd1574-96e1-476d-8ff3-adcbac643dd9 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:26:57.626605 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:26:57.629937 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7332aa31-b930-409e-8b95-a1c52709fe3f req-4675a942-af3f-498a-aec0-f18f67378ad7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.20 "DELETE /v2.0/ports/25dd1574-96e1-476d-8ff3-adcbac643dd9 HTTP/1.1" status: 204 len: 173 time: 0.3927062 Dec 14 03:26:57.630375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'name': 'network-vif-deleted', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:26:57.632614 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a70e5345-ec15-4890-a904-d6a770385389" -d '{"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-deleted", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:26:57.669639 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:26:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 x-openstack-request-id: req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:26:57.669969 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-deleted", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:26:57.670230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:26:57.670702 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50748e4e-0c67-4ef1-b581-fbbe246bb0a4', 'name': 'network-vif-deleted', 'tag': '25dd1574-96e1-476d-8ff3-adcbac643dd9', 'status': 'completed', 'code': 200} Dec 14 03:26:57.915113 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7f206df6-589f-4e29-9604-ae2c583a5637 req-ebf3e1b2-fb6d-45d4-9ab1-e2aad8cd2727 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /v2.0/ports?device_id=50748e4e-0c67-4ef1-b581-fbbe246bb0a4 HTTP/1.1" status: 200 len: 210 time: 0.0246480 Dec 14 03:27:02.107821 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 25dd1574-96e1-476d-8ff3-adcbac643dd9 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:27:02.127808 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 25dd1574-96e1-476d-8ff3-adcbac643dd9 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:27:02.128148 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 25dd1574-96e1-476d-8ff3-adcbac643dd9 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:27:11.333473 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:19.695831 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2723295d-4993-4717-8f03-b9b654c00a62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:19.989205 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:27:21.654272 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59526) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:21.697528 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Deleting subnet a6c074a3-5bd9-40d4-851f-ebde92b04ca9 {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:27:21.700531 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.732647 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.770575 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.823284 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.849667 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.852944 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/a6c074a3-5bd9-40d4-851f-ebde92b04ca9 HTTP/1.1" status: 204 len: 168 time: 0.1976550 Dec 14 03:27:21.853889 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99d770da-c776-4571-b613-058b7243e4c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a6c074a3-5bd9-40d4-851f-ebde92b04ca9,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:21.855492 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59528) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:21.890328 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-424dc07d-d4f5-482b-b40c-80ea1e241c32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:21.923856 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.002867 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.022139 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4bbf6845-f34a-4527-8c1c-a97ce74db8b8']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:22.031091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '70f42285-8687-411c-9329-dc4b2583537e') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:22.031387 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '70f42285-8687-411c-9329-dc4b2583537e') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:22.040961 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.054236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.060758 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Releasing vlan 291 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:27:22.061132 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:27:22.062764 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:27:22.113363 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.119370 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.122732 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] 10.222.0.43 "DELETE /v2.0/networks/4bbf6845-f34a-4527-8c1c-a97ce74db8b8 HTTP/1.1" status: 204 len: 168 time: 0.2663152 Dec 14 03:27:22.133483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eefd104-584a-4d2f-90c2-b11e0d0f1ea5 admin admin] Pushing event deleted for resources: {'Network': ['ID=4bbf6845-f34a-4527-8c1c-a97ce74db8b8,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:22.280773 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59532) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:22.320336 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-7bf021e0-8520-45d5-8852-aa66a1ddde1a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=78c0550396bb4156a986650fecac5f28&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384150 Dec 14 03:27:22.322559 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59534) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:22.367652 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.387149 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.432154 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.434939 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:22.436104 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/069e4661-5e85-4226-86e1-4c9fa6f22dd6 HTTP/1.1" status: 204 len: 168 time: 0.1126506 Dec 14 03:27:22.444596 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=069e4661-5e85-4226-86e1-4c9fa6f22dd6,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:22.451570 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.451930 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.452281 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.452627 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.452968 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.453304 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.453638 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.453970 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.454303 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.454636 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.454965 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.455322 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:22.455647 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c35763b4-4e5f-40bf-a9d9-ee0a9e8a39ae admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:23.074766 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59556) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:23.167674 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1226270651-network', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:23.191940 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Made reservation on behalf of 84ffd96b68cf41c5a9be418ed8c0c61a for: {'network': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:27:23.194184 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.202836 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.275108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.278794 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.306691 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 295} {{(pid=102572) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:27:23.311182 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e96db4ed-0618-4db3-a351-bc156ef4fad7,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:23.322523 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.322932 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.segments_db [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Added segment 87de8013-89e0-4dd5-a252-53fc717aecda of type vlan for network 1a26c104-e4b3-4523-972d-5602ee9f495b Dec 14 03:27:23.365454 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.389572 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.390548 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:23.391135 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.441261 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3653738 Dec 14 03:27:23.445354 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59560) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:23.450278 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Request body: {'subnet': {'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1226270651-subnet', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'ip_version': 4}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:23.453894 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723617be-6590-4d4d-a86a-210c7f7624ec admin admin] Pushing event updated for resources: {'Network': ['ID=1a26c104-e4b3-4523-972d-5602ee9f495b,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:23.463522 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network 1a26c104-e4b3-4523-972d-5602ee9f495b details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:27:23.470307 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Made reservation on behalf of 84ffd96b68cf41c5a9be418ed8c0c61a for: {'subnet': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:27:23.472589 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-12477423'] for subnet, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.622144 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.632936 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2037184', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-12477425'] for subnet, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.690314 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Pushing event updated for resources: {'Subnet': ['ID=451cc1f2-8364-4085-b29b-55aa3dffa6ca,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:23.698588 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Checking segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:23.698945 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Network hostable DHCP agents. Network: 1a26c104-e4b3-4523-972d-5602ee9f495b, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102571) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:27:23.715596 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Network 1a26c104-e4b3-4523-972d-5602ee9f495b is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102571) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:27:23.723292 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, 1a26c104-e4b3-4523-972d-5602ee9f495b) {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:23.727095 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:23.728227 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.733032 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f577d352-74ca-4b07-a00e-653acac3c77a None None] Network 1a26c104-e4b3-4523-972d-5602ee9f495b requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:27:23.744021 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3c5f982f-8bba-4a1f-954b-6b58cafcff12 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2975163 Dec 14 03:27:23.746334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59562) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:23.750477 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:23.769312 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.770185 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.824434 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.956436 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-1a26c104-e4b3-4523-972d-5602ee9f495b', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:27:23.957292 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:23.964740 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.084651 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Allocated IP 172.20.0.2 (1a26c104-e4b3-4523-972d-5602ee9f495b/451cc1f2-8364-4085-b29b-55aa3dffa6ca/d2869f93-acef-4b08-8e27-7424b2cab322) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:24.155908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.174241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.226209 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.231979 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.271807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Allocated IP 172.27.3.36 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/ae4f0186-4093-4cec-ab04-4eca650cb512) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:24.276039 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Network 1a26c104-e4b3-4523-972d-5602ee9f495b is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:24.278816 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:24.283201 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:24.285166 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Pushing event updated for resources: {'Port': ['ID=d2869f93-acef-4b08-8e27-7424b2cab322,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:24.335285 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Attempting to bind port d2869f93-acef-4b08-8e27-7424b2cab322 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:24.335571 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Attempting to bind port d2869f93-acef-4b08-8e27-7424b2cab322 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:24.336051 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Attempting to bind port d2869f93-acef-4b08-8e27-7424b2cab322 on network 1a26c104-e4b3-4523-972d-5602ee9f495b {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:24.341658 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 26, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:24.342029 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Checking segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:24.342427 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.342817 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Bound using segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:24.343289 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Bound port: d2869f93-acef-4b08-8e27-7424b2cab322, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:24.343665 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.374663 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.403327 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] For port d2869f93-acef-4b08-8e27-7424b2cab322, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:24.406470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] For port d2869f93-acef-4b08-8e27-7424b2cab322, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d2869f93-acef-4b08-8e27-7424b2cab322,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:24.408159 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.410217 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.449036 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:24.452147 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:24.455731 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:24.463321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Pushing event updated for resources: {'Port': ['ID=ae4f0186-4093-4cec-ab04-4eca650cb512,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:24.473406 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c15b039-2454-4115-b7b4-519aea80b3d0 None None] Pushing event updated for resources: {'Port': ['ID=d2869f93-acef-4b08-8e27-7424b2cab322,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:24.640621 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.801980 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d2869f93-acef-4b08-8e27-7424b2cab322 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:24.850747 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port d2869f93-acef-4b08-8e27-7424b2cab322 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:24.851028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.929416 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.964510 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port d2869f93-acef-4b08-8e27-7424b2cab322, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d2869f93-acef-4b08-8e27-7424b2cab322,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:24.968844 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:24.971386 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.022025 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=d2869f93-acef-4b08-8e27-7424b2cab322,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:25.171230 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.299744 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Router 6317f851-cf01-4746-8148-5f72c1fcc54f is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102571) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:27:25.369519 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e71ff4f-47ac-4681-a1f9-64bcf788ecf8 None None] Network 1a26c104-e4b3-4523-972d-5602ee9f495b requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:27:25.413181 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:27:25.425938 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Sync routers for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:27:25.431960 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.433285 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-8adfeda3-180b-44fc-b920-e932cd27c836 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.6860406 Dec 14 03:27:25.436057 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59564) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:25.450034 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-4f6e81f0-eb5e-4d8e-bf5c-3d270b7c841f None None] Provisioning complete for port d2869f93-acef-4b08-8e27-7424b2cab322 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:25.450404 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-4f6e81f0-eb5e-4d8e-bf5c-3d270b7c841f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.454394 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:25.455026 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:25.639522 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:25.842069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.855285 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.871578 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:24Z', 'revision_number': 3, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:25.875007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-82239c84-871a-40ce-a841-fcf535c739de None None] Provisioning complete for port d2869f93-acef-4b08-8e27-7424b2cab322 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:25.875347 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-82239c84-871a-40ce-a841-fcf535c739de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:25.901232 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Checking router: 6317f851-cf01-4746-8148-5f72c1fcc54f for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:27:25.901507 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Updating router 6317f851-cf01-4746-8148-5f72c1fcc54f port ae4f0186-4093-4cec-ab04-4eca650cb512 binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:27:25.950136 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.008373 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Allocated IP 172.20.0.1 (1a26c104-e4b3-4523-972d-5602ee9f495b/451cc1f2-8364-4085-b29b-55aa3dffa6ca/6f67ab90-b55b-45cb-9600-5ad87ca4c9a0) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:26.115326 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.149218 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.188880 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Network 1a26c104-e4b3-4523-972d-5602ee9f495b is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:26.193043 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:26.197867 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:26.200815 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Pushing event updated for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:26.231316 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.236847 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.237374 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.296124 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Attempting to bind port ae4f0186-4093-4cec-ab04-4eca650cb512 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:26.296571 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Attempting to bind port ae4f0186-4093-4cec-ab04-4eca650cb512 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:26.296944 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Attempting to bind port ae4f0186-4093-4cec-ab04-4eca650cb512 on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:26.300362 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad86f41-a3ca-4170-baac-b37e82cc0f81 None None] Pushing event updated for resources: {'Port': ['ID=ae4f0186-4093-4cec-ab04-4eca650cb512,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:26.306967 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:26.307377 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:26.307798 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.308177 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:26.308651 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Bound port: ae4f0186-4093-4cec-ab04-4eca650cb512, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:26.309037 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.366060 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] For port ae4f0186-4093-4cec-ab04-4eca650cb512, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:26.371721 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] For port ae4f0186-4093-4cec-ab04-4eca650cb512, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=ae4f0186-4093-4cec-ab04-4eca650cb512,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:26.373714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.379408 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.451159 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:26.451777 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:26.453574 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad86f41-a3ca-4170-baac-b37e82cc0f81 None None] Pushing event updated for resources: {'Port': ['ID=ae4f0186-4093-4cec-ab04-4eca650cb512,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:26.538308 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.541644 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-3231ab49-513c-4e74-a2ee-b1b401ba56db None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:26.542008 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-3231ab49-513c-4e74-a2ee-b1b401ba56db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.543614 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.591179 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:26.609931 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.611755 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Pushing event updated for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:26.617934 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-3231ab49-513c-4e74-a2ee-b1b401ba56db None None] Port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:27:26.700756 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Network 1a26c104-e4b3-4523-972d-5602ee9f495b is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:26.702286 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:26.835792 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Router 6317f851-cf01-4746-8148-5f72c1fcc54f has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:27:26.853554 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d2869f93-acef-4b08-8e27-7424b2cab322 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:26.950538 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:27:26.955726 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-cee772b3-3955-45c3-b763-e7d619583ea3 admin admin] 10.222.0.43 "PUT /v2.0/routers/6317f851-cf01-4746-8148-5f72c1fcc54f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5187020 Dec 14 03:27:26.958019 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port d2869f93-acef-4b08-8e27-7424b2cab322 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:26.958394 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:26.992647 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-5d51dd75-ebb8-43ab-8d5f-26705b1995fb None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:26.992901 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5d51dd75-ebb8-43ab-8d5f-26705b1995fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.040452 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-5d51dd75-ebb8-43ab-8d5f-26705b1995fb None None] Port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:27:27.051609 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 1, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:27.100850 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b31b9dd7-b508-4dff-9440-4694386328e3 None None] The sync data for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi is: [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 1, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:27:27.441211 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59582) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:27.446927 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-691376641-network', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:27.468189 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Made reservation on behalf of 32ff09be74fb44fa9cd1bba92f63f7d6 for: {'network': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:27:27.470624 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for network, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.479683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.558427 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.562286 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.583560 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 285} {{(pid=102571) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 14 03:27:27.598591 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d02ee18-3e7f-4560-b3cb-65fd72301917,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:27.601484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.601823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.segments_db [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Added segment 212df66f-d62f-470a-893b-f4b1c778096e of type vlan for network c1c22778-60af-4c9e-bdc7-44a03effc217 Dec 14 03:27:27.642145 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8763911708209'] for network, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.678764 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191'] for network, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.679903 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:27.681229 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.745365 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3022478 Dec 14 03:27:27.748753 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59584) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:27.753589 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a04e7-506d-44aa-b89e-bd0c09a6610d admin admin] Pushing event updated for resources: {'Network': ['ID=c1c22778-60af-4c9e-bdc7-44a03effc217,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:27.754838 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Request body: {'subnet': {'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-691376641-subnet', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'ip_version': 4}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:27.766222 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Network c1c22778-60af-4c9e-bdc7-44a03effc217 details requested by agent ovs-agent-dv-cinder-818037-8-iscsi with host dv-cinder-818037-8-iscsi {{(pid=102573) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 14 03:27:27.789458 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Made reservation on behalf of 32ff09be74fb44fa9cd1bba92f63f7d6 for: {'subnet': 1} {{(pid=102572) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:27:27.792234 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8547576'] for subnet, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:27.973330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-12248346', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8547558'] for subnet, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.026232 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Pushing event updated for resources: {'Subnet': ['ID=01f6283a-0b59-40c4-9ff4-b4af3a4e47b9,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:28.036371 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Checking segment: {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102572) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:28.037321 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Network hostable DHCP agents. Network: c1c22778-60af-4c9e-bdc7-44a03effc217, hostable agents: ['da499931-d929-44da-891f-aa0943b72a86'], hosted agents: [] {{(pid=102572) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 14 03:27:28.054923 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Network c1c22778-60af-4c9e-bdc7-44a03effc217 is scheduled to be hosted by DHCP agent da499931-d929-44da-891f-aa0943b72a86 with binding_index 1 {{(pid=102572) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 14 03:27:28.064882 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-818037-8-iscsi, c1c22778-60af-4c9e-bdc7-44a03effc217) {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:28.069020 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102572) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:28.069692 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.077620 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c818762-24b3-40fb-be99-5d0ba606c72c None None] Network c1c22778-60af-4c9e-bdc7-44a03effc217 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:27:28.089143 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-605a9b95-0c1b-4dfb-bea9-04c78768d496 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3358822 Dec 14 03:27:28.089421 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59586) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:28.093724 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:28.116521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3730891', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7283'] for router, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.118487 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3729787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3676554', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3675595', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7274'] for router, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.173962 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.195769 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp46cefdae-2057-568e-a5e8-388c4ef1c646-c1c22778-60af-4c9e-bdc7-44a03effc217', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9'}]}} from dv-cinder-818037-8-iscsi. {{(pid=102573) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 14 03:27:28.196705 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.315486 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.341875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.db_base_plugin_common [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Allocated IP 172.20.0.2 (c1c22778-60af-4c9e-bdc7-44a03effc217/01f6283a-0b59-40c4-9ff4-b4af3a4e47b9/5f511d88-c260-4310-b3bb-2dbc76fdbc08) {{(pid=102573) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:28.492386 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks [] for port, precommit_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.498159 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987'] for port, after_create {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.521529 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.538481 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Network c1c22778-60af-4c9e-bdc7-44a03effc217 is already hosted by enough agents. {{(pid=102573) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:28.541128 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.541981 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.scheduler.base_scheduler [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Resources bound (agent type, host, resource id): {{(pid=102573) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:28.545695 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Received port after_create {{(pid=102573) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:28.558767 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Pushing event updated for resources: {'Port': ['ID=5f511d88-c260-4310-b3bb-2dbc76fdbc08,revision_number=1']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:28.603083 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Attempting to bind port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:28.603623 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Attempting to bind port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:28.604126 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Attempting to bind port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 on network c1c22778-60af-4c9e-bdc7-44a03effc217 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:28.609775 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:28.610282 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Checking segment: {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:28.610803 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.611310 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Bound using segment: {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:28.611789 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Bound port: 5f511d88-c260-4310-b3bb-2dbc76fdbc08, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:28.612180 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.641728 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Allocated IP 172.27.3.248 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/c3a67507-30b1-478f-99d6-330b5442370f) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:28.677410 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] For port 5f511d88-c260-4310-b3bb-2dbc76fdbc08, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:28.680791 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] For port 5f511d88-c260-4310-b3bb-2dbc76fdbc08, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=5f511d88-c260-4310-b3bb-2dbc76fdbc08,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:28.685051 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.746513 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827b8ad9-cbf1-4e24-9c60-3da0fbde6e28 None None] Pushing event updated for resources: {'Port': ['ID=5f511d88-c260-4310-b3bb-2dbc76fdbc08,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:28.755452 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.796196 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:28.840851 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ae4f0186-4093-4cec-ab04-4eca650cb512 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:28.850668 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:28.854102 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:28.856506 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:28.880147 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Pushing event updated for resources: {'Port': ['ID=c3a67507-30b1-478f-99d6-330b5442370f,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:28.901284 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port ae4f0186-4093-4cec-ab04-4eca650cb512 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:28.901660 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.032136 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.055790 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port ae4f0186-4093-4cec-ab04-4eca650cb512, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=ae4f0186-4093-4cec-ab04-4eca650cb512,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:29.063741 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.130649 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=ae4f0186-4093-4cec-ab04-4eca650cb512,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:29.183870 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Sync routers for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:27:29.194324 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:29.194976 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:29.393064 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:29.436168 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.591632 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 2, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:29.623260 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Checking router: 6317f851-cf01-4746-8148-5f72c1fcc54f for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:27:29.623621 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Updating router 6317f851-cf01-4746-8148-5f72c1fcc54f port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:27:29.626889 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3729730', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3676665'] for router, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.650243 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.764324 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Router 4df6906c-be31-42f3-9234-a36bd03a3198 is scheduled to L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 with binding_index 1 {{(pid=102572) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 14 03:27:29.880609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:27:29.889491 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Sync routers for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:27:29.901325 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:29.902168 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:29.903561 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.905797 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c0192af0-449a-4f29-b083-072998f3b1ff admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.8153894 Dec 14 03:27:29.907596 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59588) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:29.946338 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.953433 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:29.958654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5de7235a-57ce-4881-a0f0-3ad5e9f726bb None None] Network c1c22778-60af-4c9e-bdc7-44a03effc217 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:27:30.002334 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Pushing event updated for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:30.019907 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.020479 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.020989 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.021475 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.021810 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.022144 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.022466 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.022790 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.023133 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.023471 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.023793 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.024664 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.024988 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102574) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:30.077031 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] Provisioning complete for port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:30.077403 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.079604 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Attempting to bind port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:30.080280 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Attempting to bind port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:30.080421 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Attempting to bind port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 on network 1a26c104-e4b3-4523-972d-5602ee9f495b {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:30.085691 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:30.086064 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Checking segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:30.087124 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.087482 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Bound using segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:30.087890 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Bound port: 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:30.088289 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.119256 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:30.159991 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] For port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:30.163682 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] For port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:30.171591 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.237775 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:30.239394 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:30.335612 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.353534 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5a6242-cb6e-41da-aeeb-75fad9295d1c None None] Pushing event updated for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:30.370189 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:30.390647 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] For port 5f511d88-c260-4310-b3bb-2dbc76fdbc08, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=5f511d88-c260-4310-b3bb-2dbc76fdbc08,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:30.403974 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.409433 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.469094 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 3, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:30.509554 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Checking router: 4df6906c-be31-42f3-9234-a36bd03a3198 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:27:30.509907 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Updating router 4df6906c-be31-42f3-9234-a36bd03a3198 port c3a67507-30b1-478f-99d6-330b5442370f binding host dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:27:30.512927 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d214fd4-1940-4c2b-ba82-aa4137a787fa None None] Pushing event updated for resources: {'Port': ['ID=5f511d88-c260-4310-b3bb-2dbc76fdbc08,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:30.561241 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.655873 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_common [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Allocated IP 172.20.0.1 (c1c22778-60af-4c9e-bdc7-44a03effc217/01f6283a-0b59-40c4-9ff4-b4af3a4e47b9/fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa) {{(pid=102572) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:30.676330 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:30.706539 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c4231fc-cdd2-484a-95e7-98896fa3bb2b None None] The sync data for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi is: [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:27:30.732670 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:30.733037 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.792423 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.840292 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.896689 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Network c1c22778-60af-4c9e-bdc7-44a03effc217 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:30.899849 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:30.919803 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Received port after_create {{(pid=102572) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:30.936249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:30.968447 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 5f511d88-c260-4310-b3bb-2dbc76fdbc08 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:30.971382 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Pushing event updated for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:30.976747 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3728778'] for router_interface, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.040634 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] For port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:31.053597 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.139976 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.146933 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:31.147334 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.175908 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks [] for port, precommit_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.196021 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.200285 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Pushing event updated for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:31.221877 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.222194 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.222538 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.222872 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.223234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.223562 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.223888 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.224212 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.224536 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.224875 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.225174 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.225491 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.225806 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa552098-be12-45e0-9b2a-2d8756e8c7c2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:31.237027 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Provisioning complete for port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:31.237398 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.302117 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Attempting to bind port c3a67507-30b1-478f-99d6-330b5442370f on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:31.302489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Attempting to bind port c3a67507-30b1-478f-99d6-330b5442370f by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:31.302842 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Attempting to bind port c3a67507-30b1-478f-99d6-330b5442370f on network d05a17b1-467e-47d1-82d5-54575b429fe9 {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:31.324054 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:31.324279 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.324406 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Checking segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102573) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:31.324619 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.325007 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Bound using segment: {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'} {{(pid=102573) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:31.325533 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.managers [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Bound port: c3a67507-30b1-478f-99d6-330b5442370f, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f88eb15-2764-4f4a-bab3-999e2902629a', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9'}}] {{(pid=102573) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:31.325823 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.329374 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-12248211'] for port, after_update {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.345625 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26be2b6d-a9ac-428c-8ed0-19bb59eaa6aa None None] Pushing event updated for resources: {'Port': ['ID=c3a67507-30b1-478f-99d6-330b5442370f,revision_number=2']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:31.372607 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:27:31.394932 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Pushing event updated for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=2']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:31.397584 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3715141', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3727674'] for router_interface, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.405893 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:31.433362 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Provisioning complete for port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:31.433895 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.458642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] For port c3a67507-30b1-478f-99d6-330b5442370f, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102573) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:31.486047 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] For port c3a67507-30b1-478f-99d6-330b5442370f, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c3a67507-30b1-478f-99d6-330b5442370f,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:31.497784 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.503397 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Network c1c22778-60af-4c9e-bdc7-44a03effc217 is already hosted by enough agents. {{(pid=102572) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:31.504905 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.base_scheduler [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Resources bound (agent type, host, resource id): {{(pid=102572) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:31.593774 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:31.594155 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.625769 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Router 4df6906c-be31-42f3-9234-a36bd03a3198 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:27:31.629248 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:31.629892 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:31.631674 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26be2b6d-a9ac-428c-8ed0-19bb59eaa6aa None None] Pushing event updated for resources: {'Port': ['ID=c3a67507-30b1-478f-99d6-330b5442370f,revision_number=3']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:31.739126 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:27:31.744475 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8df7260f-bf66-48cf-9d33-eec597ee862b admin admin] 10.222.0.43 "PUT /v2.0/routers/4df6906c-be31-42f3-9234-a36bd03a3198/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8356216 Dec 14 03:27:31.754759 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:31.755309 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c8095006-00f7-428b-bb96-a8950cc7d71f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:31.795068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:31.901152 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ae4f0186-4093-4cec-ab04-4eca650cb512 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:32.053337 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port ae4f0186-4093-4cec-ab04-4eca650cb512 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:32.053337 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.131332 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa', 'name': '', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'mac_address': 'fa:16:3e:64:c6:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:30Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 2, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'subnets': [{'id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:32.183834 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aa3c470-b5de-44a6-ac5c-4f45485ccc78 None None] The sync data for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi is: [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa', 'name': '', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'mac_address': 'fa:16:3e:64:c6:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:30Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 2, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'subnets': [{'id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:27:32.212979 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-241ed850-cc9e-4d68-b243-620220b3b33b None None] Provisioning complete for port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:32.213200 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-241ed850-cc9e-4d68-b243-620220b3b33b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.216551 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59596) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.222479 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1495078552', 'description': 'tempest-secgroup-smoke-1495078552 description', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.246323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.249770 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-241ed850-cc9e-4d68-b243-620220b3b33b None None] Port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:27:32.314027 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.318015 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.348992 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.351621 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1320930 Dec 14 03:27:32.351621 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814a071e-0a5c-4f44-baca-282cd12ace23 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8a2644d2-6e17-4a79-bff4-f57fa2ca3787,revision_number=1']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:32.353325 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59598) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.357850 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.410419 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.474165 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.478555 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.497446 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=18fe8196-8450-4437-99f3-b1ebe21ec66d,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:32.507467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.508709 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-48871844-86b0-41da-b187-86888f765ce0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1543837 Dec 14 03:27:32.511456 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59600) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.516569 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.546137 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.605842 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.610789 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.629010 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0e5cde7-3523-4d48-90d0-82de5827743e,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:32.638078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.641847 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-79026f33-4635-4e2b-bff7-f5215b69e070 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1269035 Dec 14 03:27:32.642054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59602) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.646626 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.683557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.751220 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.755734 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.776322 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90623152-d5a1-4242-9589-6d1bed99cb1a,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:32.783660 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.784890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-d91a5ad1-b4e9-43fb-a125-af1320e525be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1418991 Dec 14 03:27:32.787668 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 59604) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.792700 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.v2.base [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102572) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.807819 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:32.823031 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.857086 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:32.857458 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.880327 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.884275 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.902788 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0194a155-d07c-4b4b-b925-b577fadc65ad,revision_number=0']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:32.911323 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:32.915235 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-93191323-4392-4c4c-8e10-a16b6e86c391 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1239440 Dec 14 03:27:32.915719 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59606) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:32.920858 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:32.944294 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.securitygroups_db [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Project 84ffd96b68cf41c5a9be418ed8c0c61a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:27:32.950417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.010726 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.014309 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.030969 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=642cf734-97b8-49de-9351-699ec9cbd0fe,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:33.039269 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.040504 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-bcd0f1cf-28ba-4c0a-9bd5-9df9fe58e1dc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1236343 Dec 14 03:27:33.043299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59608) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:27:33.047541 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'security_group_rule': {'security_group_id': '8a2644d2-6e17-4a79-bff4-f57fa2ca3787', 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:33.068474 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.securitygroups_db [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Project 84ffd96b68cf41c5a9be418ed8c0c61a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 14 03:27:33.073838 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.131375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.135288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-417496'] for security_group_rule, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.152236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3f12e247-cfe9-4e01-b820-6f93523fa004,revision_number=0']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:33.158948 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:33.160113 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-36a249fe-ebac-41e2-b4d7-1d3e2c706fe2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1158359 Dec 14 03:27:34.798936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c3a67507-30b1-478f-99d6-330b5442370f up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:34.848669 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port c3a67507-30b1-478f-99d6-330b5442370f triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:34.849207 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:34.853480 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Sync routers for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:27:34.866766 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:34.867397 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:34.926656 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:34.946242 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] For port c3a67507-30b1-478f-99d6-330b5442370f, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c3a67507-30b1-478f-99d6-330b5442370f,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:34.950984 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:34.975954 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:35.000565 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Pushing event updated for resources: {'Port': ['ID=c3a67507-30b1-478f-99d6-330b5442370f,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:35.173471 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa', 'name': '', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'mac_address': 'fa:16:3e:64:c6:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:30Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 2, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'subnets': [{'id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:35.200850 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Checking router: 4df6906c-be31-42f3-9234-a36bd03a3198 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:27:35.201212 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Updating router 4df6906c-be31-42f3-9234-a36bd03a3198 port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa binding host dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 14 03:27:35.227162 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.566020 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks [] for port, precommit_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.570937 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.621834 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a453a290-e64b-4c00-87c6-705e25618195 None None] Pushing event updated for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=3']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:35.673167 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Attempting to bind port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa on host dv-cinder-818037-8-iscsi for vnic_type normal with profile {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:27:35.673534 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Attempting to bind port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa by drivers openvswitch,hyperv on host dv-cinder-818037-8-iscsi at level 0 using segments [{'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:27:35.673896 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Attempting to bind port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa on network c1c22778-60af-4c9e-bdc7-44a03effc217 {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:27:35.679092 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Checking agent: {'id': 'cbecfd6a-8f52-4574-a37e-43b0c58c1ce4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-818037-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 6, 56), 'started_at': datetime.datetime(2021, 12, 14, 3, 7, 26), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-818037-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:27:35.679464 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Checking segment: {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102574) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:27:35.679860 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.680906 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Bound using segment: {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'} {{(pid=102574) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:27:35.681378 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.managers [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Bound port: fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa, host: dv-cinder-818037-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '212df66f-d62f-470a-893b-f4b1c778096e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 285, 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217'}}] {{(pid=102574) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:27:35.681759 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.747838 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] For port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa, host dv-cinder-818037-8-iscsi, cleared binding levels {{(pid=102574) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:27:35.751014 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.plugins.ml2.db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] For port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa, host dv-cinder-818037-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102574) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:27:35.756503 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron_lib.callbacks.manager [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102574) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.808384 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] Provisioning complete for port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:35.808951 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.810893 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:27:35.811626 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:35.855588 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a453a290-e64b-4c00-87c6-705e25618195 None None] Pushing event updated for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=4']} {{(pid=102574) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:35.903462 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:35.937606 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:27:35.938116 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] For port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:27:35.942930 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:36.006420 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ac76ff-ba4c-4603-8bde-82950ecfc452 None None] Pushing event updated for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:36.062523 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-c4748440-e6f9-450a-ad95-f1e62ec54c04 None None] Provisioning complete for port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:36.062898 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c4748440-e6f9-450a-ad95-f1e62ec54c04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:36.150999 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa', 'name': '', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'mac_address': 'fa:16:3e:64:c6:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:30Z', 'updated_at': '2021-12-14T03:27:35Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'subnets': [{'id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:27:36.176665 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61fab850-90b4-4011-8ab5-7a835fee24b9 None None] The sync data for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi is: [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:31Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': 'fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa', 'name': '', 'network_id': 'c1c22778-60af-4c9e-bdc7-44a03effc217', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'mac_address': 'fa:16:3e:64:c6:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_interface', 'standard_attr_id': 687, 'fixed_ips': [{'subnet_id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:30Z', 'updated_at': '2021-12-14T03:27:35Z', 'revision_number': 4, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'subnets': [{'id': '01f6283a-0b59-40c4-9ff4-b4af3a4e47b9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:27:36.810028 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:36.856339 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:36.856704 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:36.937621 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c3a67507-30b1-478f-99d6-330b5442370f up at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:27:36.981478 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Provisioning complete for port c3a67507-30b1-478f-99d6-330b5442370f triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:36.981782 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:41.349896 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:49.338125 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-43d21ba3-21b0-4359-99db-d11e9186ede6 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0386717 Dec 14 03:27:49.445060 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-4857b29f-3b69-492b-b579-a249f7a9c0c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:49.446514 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-4857b29f-3b69-492b-b579-a249f7a9c0c2 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0396378 Dec 14 03:27:49.548769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-615f7367-6a79-4c44-a814-82ee82972d91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:49.550195 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-615f7367-6a79-4c44-a814-82ee82972d91 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0840461 Dec 14 03:27:49.614698 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-24896859-5686-458e-8255-a7f95b16d6b2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 1000 time: 0.0557446 Dec 14 03:27:49.663718 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-1b14d24f-3c52-487a-ae58-21082c1f0eed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:49.665142 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-1b14d24f-3c52-487a-ae58-21082c1f0eed service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0422201 Dec 14 03:27:49.696881 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-4e1d5772-a86c-4c77-ab23-11c171d1a2a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:49.716406 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-cb5b0264-067e-45e4-b461-d0184735fbf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:49.717865 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-cb5b0264-067e-45e4-b461-d0184735fbf6 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427165 Dec 14 03:27:49.803017 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-a13a669e-aca7-4c8f-93a7-c8c7cb0f3dd3 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0773048 Dec 14 03:27:49.895176 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-73654cd0-6ba1-42f2-a35f-6aa08abec046 req-1fce04a4-3049-4ea1-9388-a754d8ae8bf9 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813904 Dec 14 03:27:51.891926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-50b2e90e-5bbb-40ee-956b-9b3344abdb5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:53.623411 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:54.643328 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:55.804567 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:56.782716 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-d000db02-e66f-4df2-9567-834f7bce689f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1495078552&fields=id&tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a HTTP/1.1" status: 200 len: 267 time: 0.0445230 Dec 14 03:27:56.883774 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-61b98697-5356-4634-863e-fde739b927cd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:56.885109 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-61b98697-5356-4634-863e-fde739b927cd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 809 time: 0.0957818 Dec 14 03:27:56.899193 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-476c2742-8126-4f53-9db5-ff7811ba77f6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/quotas/84ffd96b68cf41c5a9be418ed8c0c61a HTTP/1.1" status: 200 len: 375 time: 0.0084164 Dec 14 03:27:56.951742 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-f48e3018-f376-455a-9610-05961819b0e1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0470521 Dec 14 03:27:56.987490 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:27:57.187838 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-a6c7f2f8-43aa-4e92-985a-f9fc64c36ca0 service neutron] 10.222.0.43 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2249358 Dec 14 03:27:57.515369 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-654b0254-7750-46c2-8daf-83ddbea0cfaf service neutron] 10.222.0.43 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3214412 Dec 14 03:27:57.790324 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-12efea71-b918-47f0-b5f3-8ef189211ef8 req-38603c6b-3fc0-49b4-b248-4ea59520ae28 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 210 time: 0.0261717 Dec 14 03:27:58.817327 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-4cc822cc-ba4b-412f-b1e1-f9a5faa50f70 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:58.818811 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-4cc822cc-ba4b-412f-b1e1-f9a5faa50f70 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 809 time: 0.1140716 Dec 14 03:27:58.900414 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4ea60279-fefc-4abc-a075-6985c0e835b8 req-e614596b-1681-4f6b-b563-c14175356008 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 210 time: 0.0390282 Dec 14 03:27:58.937954 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-729b07dc-c3c9-4f6c-9923-9e805a188117 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a HTTP/1.1" status: 200 len: 380 time: 0.0822494 Dec 14 03:27:58.947953 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'port': {'device_id': 'ebdfbba3-0077-46f6-af60-35f085357682', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'admin_state_up': True, 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'security_groups': ['8a2644d2-6e17-4a79-bff4-f57fa2ca3787']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:59.049613 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Made reservation on behalf of 84ffd96b68cf41c5a9be418ed8c0c61a for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:27:59.053278 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.187442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Allocated IP 172.20.0.4 (1a26c104-e4b3-4523-972d-5602ee9f495b/451cc1f2-8364-4085-b29b-55aa3dffa6ca/f5625fc9-aa99-4f98-9a5d-b0f54296bb68) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:27:59.321117 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.358062 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.404779 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Network 1a26c104-e4b3-4523-972d-5602ee9f495b is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:27:59.407908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:27:59.410441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:27:59.450421 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:27:59.466726 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.467091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.467440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.467778 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.468118 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.468450 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.468825 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.469375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.469500 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.469792 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.470116 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.470454 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.470804 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:27:59.493440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:27:59.494098 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.518418 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-18109985-b818-44e1-a159-1920c8af85ec tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5737545 Dec 14 03:27:59.538426 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Request body: {'port': {'device_id': 'ebdfbba3-0077-46f6-af60-35f085357682', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:27:59.596033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.713300 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-091bf3a0-2420-4d8a-9ffa-15b4c27e0834 None None] Provisioning complete for port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:27:59.714389 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-091bf3a0-2420-4d8a-9ffa-15b4c27e0834 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.746889 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-091bf3a0-2420-4d8a-9ffa-15b4c27e0834 None None] Port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:27:59.852885 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f5625fc9-aa99-4f98-9a5d-b0f54296bb68 {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:27:59.860723 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.872597 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Transition to ACTIVE for port object f5625fc9-aa99-4f98-9a5d-b0f54296bb68 will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:27:59.876334 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:27:59.924377 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:00.033019 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Attempting to bind port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:28:00.033359 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Attempting to bind port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:28:00.033693 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Attempting to bind port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 on network 1a26c104-e4b3-4523-972d-5602ee9f495b {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:28:00.040837 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 on network 1a26c104-e4b3-4523-972d-5602ee9f495b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:28:00.041174 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Attempting to bind port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 on network 1a26c104-e4b3-4523-972d-5602ee9f495b {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:28:00.052390 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-358ae5cf-01b4-4a34-a260-894ae71de759 req-307871a9-c5d5-475c-a7d2-01474c1affe6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.053915 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-358ae5cf-01b4-4a34-a260-894ae71de759 req-307871a9-c5d5-475c-a7d2-01474c1affe6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0724502 Dec 14 03:28:00.057484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 27, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:28:00.057866 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Checking segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:28:00.058258 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Bound using segment: {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:28:00.058700 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Bound port: f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87de8013-89e0-4dd5-a252-53fc717aecda', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:28:00.059088 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:00.143101 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-358ae5cf-01b4-4a34-a260-894ae71de759 req-db110f80-c56d-4d24-8009-829d0f225271 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0816612 Dec 14 03:28:00.159098 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:28:00.162255 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:28:00.166874 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:00.205942 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.206622 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:00.208025 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] 10.222.0.20 "PUT /v2.0/ports/f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 1093 time: 0.6739886 Dec 14 03:28:00.208436 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:28:00.210695 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b928aac4-ef29-456a-8a34-2a5bc1b7c116" -d '{"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:28:00.232916 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbf2cc3-d954-4d41-aa14-ea892013c792 service neutron] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:00.307910 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-4b544b93-492d-4bba-b631-ca0a7bd2be68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.309420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-4b544b93-492d-4bba-b631-ca0a7bd2be68 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1096 time: 0.0431333 Dec 14 03:28:00.362229 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:28:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-462c2314-ff20-4fe6-95b8-5173b941dab9 x-openstack-request-id: req-462c2314-ff20-4fe6-95b8-5173b941dab9 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:28:00.362517 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:28:00.362772 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-462c2314-ff20-4fe6-95b8-5173b941dab9 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:28:00.363460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'status': 'completed', 'code': 200} Dec 14 03:28:00.365212 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-09ca1b6c-0eb5-4c9e-ab0f-adc8b0f3edcd service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 217 time: 0.0372503 Dec 14 03:28:00.423103 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-9c081ae9-5fcb-499c-9e2d-bf0219d82403 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.424662 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-9c081ae9-5fcb-499c-9e2d-bf0219d82403 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0477824 Dec 14 03:28:00.469964 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e402e4-8fd0-4626-9558-70409946757e req-c9e6b95e-861c-4fbb-8619-e5eb42f0a68d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.471399 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-c9e6b95e-861c-4fbb-8619-e5eb42f0a68d service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388880 Dec 14 03:28:00.558890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-c60c0bbe-a699-46b5-932e-14e39c959645 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794690 Dec 14 03:28:00.648074 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-25e402e4-8fd0-4626-9558-70409946757e req-b71088d1-1322-4e58-809d-1b597f2a9ec6 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821180 Dec 14 03:28:00.794580 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-ec3f70ec-e8b1-4941-b7e2-637c37c0f99f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.796063 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-ec3f70ec-e8b1-4941-b7e2-637c37c0f99f service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1096 time: 0.0409803 Dec 14 03:28:00.886467 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-c0a04e84-25e9-441b-b919-2e8ec93392c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.887927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-c0a04e84-25e9-441b-b919-2e8ec93392c1 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0844302 Dec 14 03:28:00.927964 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-92b6ca85-2a78-4d9d-9b7f-b9c5183f6006 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 217 time: 0.0330775 Dec 14 03:28:00.975488 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-c7b0ecbd-c844-48b7-8de6-54dae07b8c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:00.976928 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-c7b0ecbd-c844-48b7-8de6-54dae07b8c4b service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0417538 Dec 14 03:28:01.019641 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-1ca02671-f7a2-4a50-8507-bdb019ca5afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:01.021052 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-1ca02671-f7a2-4a50-8507-bdb019ca5afe service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0374923 Dec 14 03:28:01.110353 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-66590cf4-d85f-42ed-8298-79efdf708b3a service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811458 Dec 14 03:28:01.196848 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-d5d99ab4-b10a-45e9-8bfd-a14ad5676881 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791430 Dec 14 03:28:01.263509 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec622f39-44b6-4ceb-a801-a9a8e4e507da req-9fb3180c-74dc-49d4-a925-6c73c1d71060 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:01.264871 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ec622f39-44b6-4ceb-a801-a9a8e4e507da req-9fb3180c-74dc-49d4-a925-6c73c1d71060 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0528309 Dec 14 03:28:01.313503 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ec622f39-44b6-4ceb-a801-a9a8e4e507da req-0b2d01d1-aa0f-4411-9256-56b7ff156f1c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419865 Dec 14 03:28:02.426710 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de842b4-9196-40d0-bc7b-c22215588858 req-e01f1773-28a8-46c2-b965-8d9aad6276c0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:02.428426 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3de842b4-9196-40d0-bc7b-c22215588858 req-e01f1773-28a8-46c2-b965-8d9aad6276c0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0481567 Dec 14 03:28:02.475496 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3de842b4-9196-40d0-bc7b-c22215588858 req-7eb3a07c-9270-435f-af37-b05c5a2a9e73 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406356 Dec 14 03:28:03.590955 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab req-d9dc3e13-151d-4e50-853e-b257888023bb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:03.592442 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab req-d9dc3e13-151d-4e50-853e-b257888023bb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0507638 Dec 14 03:28:03.639818 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab req-951c6b35-bfaa-4d18-b997-fb8b972e0ab5 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413253 Dec 14 03:28:04.752671 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba2d643-6b68-418e-a06e-8c9e50812386 req-2f5045d9-5340-428a-96e8-294f8180f77d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:04.754168 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ba2d643-6b68-418e-a06e-8c9e50812386 req-2f5045d9-5340-428a-96e8-294f8180f77d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0477808 Dec 14 03:28:04.801277 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6ba2d643-6b68-418e-a06e-8c9e50812386 req-d8070477-f949-4bb7-a2cb-c372905151d1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413089 Dec 14 03:28:05.913587 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827497e7-c3d0-47d2-b506-00ae694624a2 req-82a6eec8-730e-4386-8afc-91faabadaa33 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:05.914919 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-827497e7-c3d0-47d2-b506-00ae694624a2 req-82a6eec8-730e-4386-8afc-91faabadaa33 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0466816 Dec 14 03:28:05.965480 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-827497e7-c3d0-47d2-b506-00ae694624a2 req-54ee52d2-a596-457a-a830-74944f9c64f4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447569 Dec 14 03:28:07.077293 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2658eae1-1291-4ce4-82b9-85ae17435249 req-8e4ee794-ca29-4a25-9ebc-4c05130a8c31 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:07.078723 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2658eae1-1291-4ce4-82b9-85ae17435249 req-8e4ee794-ca29-4a25-9ebc-4c05130a8c31 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0469091 Dec 14 03:28:07.126550 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2658eae1-1291-4ce4-82b9-85ae17435249 req-6924a887-1a2d-4463-b468-bc552be3e100 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419695 Dec 14 03:28:08.237198 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125dd69b-560a-4334-8830-ce40a3303f12 req-47920c34-6ddb-486b-bc5c-bf10ef98bba5 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:08.238918 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-125dd69b-560a-4334-8830-ce40a3303f12 req-47920c34-6ddb-486b-bc5c-bf10ef98bba5 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0474570 Dec 14 03:28:08.286569 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-125dd69b-560a-4334-8830-ce40a3303f12 req-99461be0-ad21-46e2-a03d-02ca5825639f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418684 Dec 14 03:28:09.400715 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d1559b-70f3-4ce3-97b1-2b8607195513 req-8baf2650-5ae2-4fcc-9a94-96b64822d405 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:09.402776 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-99d1559b-70f3-4ce3-97b1-2b8607195513 req-8baf2650-5ae2-4fcc-9a94-96b64822d405 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0502765 Dec 14 03:28:09.449593 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-99d1559b-70f3-4ce3-97b1-2b8607195513 req-a082a009-bf42-4de3-b309-e5f46fd5678c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409918 Dec 14 03:28:09.656620 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:28:09.751246 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:28:09.762741 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'mac_address': 'fa:16:3e:f1:16:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 295, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:28:09.798158 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:09.813189 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f5625fc9-aa99-4f98-9a5d-b0f54296bb68 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:28:09.831968 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:28:09.835883 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:09.881373 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:10.263662 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['f5625fc9-aa99-4f98-9a5d-b0f54296bb68'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:28:10.562943 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6277186-3ea3-4469-a5b5-a040f059cb1e req-d6649bee-4774-4242-80cb-26913e0578d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:10.564443 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6277186-3ea3-4469-a5b5-a040f059cb1e req-d6649bee-4774-4242-80cb-26913e0578d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 944 time: 0.0468581 Dec 14 03:28:10.611969 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a6277186-3ea3-4469-a5b5-a040f059cb1e req-fafe5950-ac67-4270-90c5-e1324e82a480 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418153 Dec 14 03:28:11.361041 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:11.665575 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:28:11.713409 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:28:11.717938 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:28:11.718303 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:11.724554 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 req-7f076adb-9a8a-4009-a44a-5035dc5ff963 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:11.726018 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 req-7f076adb-9a8a-4009-a44a-5035dc5ff963 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 944 time: 0.0479941 Dec 14 03:28:11.778093 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 req-3f097fe9-f283-41d3-9873-3b38e83b9c91 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453005 Dec 14 03:28:11.795190 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:11.817563 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:28:11.819818 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7907eb4-bdf9-47f7-977d-73a982677924" -d '{"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:28:11.832188 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:28:11.836196 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:11.861203 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:28:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 x-openstack-request-id: req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:28:11.861489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:28:11.861739 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:28:11.862138 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'code': 200} Dec 14 03:28:11.886102 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:12.102546 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7212d6-b1c3-4e21-a383-e4c8e17d1923 req-0f6d6fa8-6c28-4228-ad51-316eb64b22a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:12.104049 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b7212d6-b1c3-4e21-a383-e4c8e17d1923 req-0f6d6fa8-6c28-4228-ad51-316eb64b22a2 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0392027 Dec 14 03:28:12.149159 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9b7212d6-b1c3-4e21-a383-e4c8e17d1923 req-82dd58fb-3077-46b7-9655-273f9dc4caf0 service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377843 Dec 14 03:28:12.896757 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2b8158-ba99-42c8-a2da-693d2d000fda req-bf490a78-b211-4918-bf4e-7cf13a85eb41 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:12.898196 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-de2b8158-ba99-42c8-a2da-693d2d000fda req-bf490a78-b211-4918-bf4e-7cf13a85eb41 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0477257 Dec 14 03:28:12.945179 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-de2b8158-ba99-42c8-a2da-693d2d000fda req-27ca17f1-ee21-48e0-a6f7-bd0d59664242 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410051 Dec 14 03:28:14.061439 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc req-bb1a537e-787d-42e0-bd2b-700603a4072b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:14.062889 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc req-bb1a537e-787d-42e0-bd2b-700603a4072b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0501986 Dec 14 03:28:14.109974 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc req-a1c8980b-fc72-4f51-82ad-5a6403ab66aa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412564 Dec 14 03:28:14.221989 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc842f6-4b33-44ee-9441-7dad789e40eb req-a972543b-779e-4287-9d4a-d7f3f62d3f7b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:14.223522 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8bc842f6-4b33-44ee-9441-7dad789e40eb req-a972543b-779e-4287-9d4a-d7f3f62d3f7b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0488303 Dec 14 03:28:14.271278 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-8bc842f6-4b33-44ee-9441-7dad789e40eb req-444b0c53-9a2e-4937-ae8e-da4226dd500d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419829 Dec 14 03:28:14.292009 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59790) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:28:14.372648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-036da92f-1237-498c-8df9-70619490807e tempest-TestShelveInstance-1084465313 tempest-TestShelveInstance-1084465313-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:14.374114 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-036da92f-1237-498c-8df9-70619490807e tempest-TestShelveInstance-1084465313 tempest-TestShelveInstance-1084465313-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1093 time: 0.0811634 Dec 14 03:28:14.376992 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59794) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:28:14.381075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'fixed_ip_address': '172.20.0.4'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:28:14.401637 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:14.500223 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:14.599862 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Allocated IP 172.27.3.52 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/97ef15ad-530f-4b0f-aa81-e98039795378) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:28:14.696934 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:14.728991 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:14.769181 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:28:14.771923 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:28:14.775436 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:28:14.799890 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'Port': ['ID=97ef15ad-530f-4b0f-aa81-e98039795378,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:15.122160 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:15.207621 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:15.350762 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:15.355119 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:15.420332 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event updated for resources: {'Port': ['ID=97ef15ad-530f-4b0f-aa81-e98039795378,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:15.430065 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:15.531663 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Floating IP 413ddf2c-ec60-4647-a5da-730b829ca6b7 associated. External IP: 172.27.3.52, port: f5625fc9-aa99-4f98-9a5d-b0f54296bb68. Dec 14 03:28:15.737677 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Router 6317f851-cf01-4746-8148-5f72c1fcc54f has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:28:16.074926 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:28:16.084303 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Sync routers for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:28:16.092599 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:16.094428 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:28:16.095068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:28:16.120432 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-7be1a126-551f-48a0-9006-34778e837e87 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7418077 Dec 14 03:28:16.121395 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:28:16.123662 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbc25a8d-0430-498e-9924-9956d5526cec" -d '{"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:28:16.158442 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:28:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 x-openstack-request-id: req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:28:16.158737 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:28:16.158993 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:28:16.159428 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'status': 'completed', 'code': 200} Dec 14 03:28:16.203760 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:28:16.240883 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc25a8d-0430-498e-9924-9956d5526cec req-4d7aa528-14e8-47e0-bcc9-9cdf2e5bb34c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:16.242351 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-4d7aa528-14e8-47e0-bcc9-9cdf2e5bb34c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0396075 Dec 14 03:28:16.331078 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc25a8d-0430-498e-9924-9956d5526cec req-390ab641-faa3-4c60-9e47-4ed2f41bc1fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:16.332437 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-390ab641-faa3-4c60-9e47-4ed2f41bc1fc service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0836627 Dec 14 03:28:16.395663 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-793ad536-2b1d-4087-ae7e-f50aa2b05247 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 998 time: 0.0558860 Dec 14 03:28:16.421247 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '413ddf2c-ec60-4647-a5da-730b829ca6b7', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'floating_ip_address': '172.27.3.52', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'mac_address': 'fa:16:3e:f1:16:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebdfbba3-0077-46f6-af60-35f085357682', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:28:14Z', 'updated_at': '2021-12-14T03:28:14Z', 'revision_number': 0, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:28:16.444061 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc25a8d-0430-498e-9924-9956d5526cec req-8b7b541e-0e7d-4eb7-980d-eea8b8049949 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:16.445531 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-8b7b541e-0e7d-4eb7-980d-eea8b8049949 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0433452 Dec 14 03:28:16.445981 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Checking router: 6317f851-cf01-4746-8148-5f72c1fcc54f for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:28:16.454130 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:28:16.454730 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:27:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:28:16.493393 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc25a8d-0430-498e-9924-9956d5526cec req-596f358a-77ff-452b-b44c-8c37b4cd885e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:16.494884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-596f358a-77ff-452b-b44c-8c37b4cd885e service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424776 Dec 14 03:28:16.558646 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:28:16.581451 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-467d6480-55ce-4ca8-b155-2759a2476505 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797861 Dec 14 03:28:16.672878 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-b682b1c2-69fe-4dcc-a1eb-fdacd3b87817 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840747 Dec 14 03:28:16.776957 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '413ddf2c-ec60-4647-a5da-730b829ca6b7', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'floating_ip_address': '172.27.3.52', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'mac_address': 'fa:16:3e:f1:16:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebdfbba3-0077-46f6-af60-35f085357682', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:28:14Z', 'updated_at': '2021-12-14T03:28:14Z', 'revision_number': 0, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:28:16.802119 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b98b0fe1-f8cd-461c-9231-34a42cbf7478 None None] The sync data for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi is: [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '413ddf2c-ec60-4647-a5da-730b829ca6b7', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'floating_ip_address': '172.27.3.52', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'mac_address': 'fa:16:3e:f1:16:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebdfbba3-0077-46f6-af60-35f085357682', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:28:14Z', 'updated_at': '2021-12-14T03:28:14Z', 'revision_number': 0, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:28:16.977450 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-117e7ce1-4533-4914-b05f-abc47069a6af None None] New status for floating IP 413ddf2c-ec60-4647-a5da-730b829ca6b7: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:28:19.700801 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9aac6bb5-79c4-4c25-b9c8-05ab9bf1999c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:21.893574 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-294cca73-4877-487d-ae6f-d89d221d3690 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:23.627365 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:24.647489 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:25.806276 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:33.985822 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:28:41.365222 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:49.304133 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-4829f885-e019-453d-92ee-2dd533923035 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0379648 Dec 14 03:28:49.400998 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-ac6e3359-4b31-438e-81ed-5dff9204c8af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:49.403000 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-ac6e3359-4b31-438e-81ed-5dff9204c8af service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0389984 Dec 14 03:28:49.505007 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-d37c2f3f-1c81-4137-be51-ba388aa17eb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:49.506428 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-d37c2f3f-1c81-4137-be51-ba388aa17eb2 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0839612 Dec 14 03:28:49.570458 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-ad36f789-74b9-4911-a059-10a771c670f3 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 1000 time: 0.0559154 Dec 14 03:28:49.619811 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-9b7f221c-0896-4769-b461-9883382a1e5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:49.621189 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-9b7f221c-0896-4769-b461-9883382a1e5d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0425255 Dec 14 03:28:49.668982 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-e571fda3-e6bc-49fb-9e5b-e81dfbad5b97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:49.670444 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-e571fda3-e6bc-49fb-9e5b-e81dfbad5b97 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416806 Dec 14 03:28:49.701624 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8ee19940-d445-47e2-910e-452356a89a27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:49.761895 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-8c9ebc02-69ba-40a4-bd29-51b1d0e18ce5 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826910 Dec 14 03:28:49.852485 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b463cf0f-206a-4ee7-9bdf-734f68f230b4 req-84c9117f-6c4c-410b-89e8-fa9b9ffba4aa service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827005 Dec 14 03:28:51.894792 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9392f501-9934-4366-a5ff-2d568591c823 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:52.389085 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-7aa4cf8e-24fb-41d0-8a8d-a9915aac2e97 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-201763541&fields=id&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 267 time: 0.0434177 Dec 14 03:28:52.491060 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-fe1be755-0edd-4a6f-a1ad-8fd59361af02 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:52.492425 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-fe1be755-0edd-4a6f-a1ad-8fd59361af02 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.0968933 Dec 14 03:28:52.507028 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d5b280dc-e6f2-40b0-bc04-38228149f930 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/quotas/d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 375 time: 0.0084696 Dec 14 03:28:52.561033 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-f5e93ef1-7170-49e9-bab7-43c5d59fcff6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0489962 Dec 14 03:28:52.649939 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-b7f95325-983e-4641-bbde-66a747a0949b service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0778518 Dec 14 03:28:52.742415 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-658f5297-a6b1-4b2a-b250-5c8c4e96f525 service neutron] 10.222.0.43 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858667 Dec 14 03:28:53.021717 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-86baea83-0b23-48ba-bf5a-47f305d89815 req-c5b91c0e-a232-4e30-8fa5-df5cffd02484 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 210 time: 0.0337727 Dec 14 03:28:53.629452 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.111426 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5593fc84-1835-4de4-a15e-a2984a2dae82 req-43c202e9-4eaa-41ef-9773-a63140829b91 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 210 time: 0.0250247 Dec 14 03:28:54.285385 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-fa641abb-948f-41a2-8bf6-6860da9bfeb6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:54.286814 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-fa641abb-948f-41a2-8bf6-6860da9bfeb6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 812 time: 0.0995822 Dec 14 03:28:54.358559 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-c52f7b6b-d5fd-4dbf-9822-84fe8209ac85 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0c4dcf4957d42b896f04f682afeef7b HTTP/1.1" status: 200 len: 379 time: 0.0568192 Dec 14 03:28:54.397663 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'port': {'device_id': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'admin_state_up': True, 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'security_groups': ['aa81265e-19a7-4c76-ae75-2b53568fe438']}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:28:54.504023 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Made reservation on behalf of d0c4dcf4957d42b896f04f682afeef7b for: {'port': 1} {{(pid=102571) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 14 03:28:54.507492 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.633073 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.20.0.12 (8f2d77d5-e58c-4a97-8899-5e1a2da29f69/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5/d552dc2f-b498-4237-8e44-bcc35ae08483) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:28:54.646892 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.765305 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.798077 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.846271 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:28:54.849301 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:28:54.852869 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:28:54.876412 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:54.907518 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:54.908168 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:54.926707 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-e8e23a62-1b8f-444a-ad96-85fc13b06d69 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5325675 Dec 14 03:28:54.946838 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Request body: {'port': {'device_id': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81803'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:28:55.003546 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.120675 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-de379dd6-4fef-44a0-9a95-6a391b83f6e9 None None] Provisioning complete for port d552dc2f-b498-4237-8e44-bcc35ae08483 triggered by entity DHCP. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:28:55.120936 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-de379dd6-4fef-44a0-9a95-6a391b83f6e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.158393 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-de379dd6-4fef-44a0-9a95-6a391b83f6e9 None None] Port d552dc2f-b498-4237-8e44-bcc35ae08483 cannot update to ACTIVE because it is not bound. {{(pid=102573) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 14 03:28:55.257612 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a3b35a-c88b-47f6-b781-1fe56e518e9d req-200b13be-974c-44c2-b1be-748e69daa41a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:55.259071 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71a3b35a-c88b-47f6-b781-1fe56e518e9d req-200b13be-974c-44c2-b1be-748e69daa41a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 932 time: 0.0783234 Dec 14 03:28:55.326369 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d552dc2f-b498-4237-8e44-bcc35ae08483 {{(pid=102571) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:28:55.341497 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.348719 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-71a3b35a-c88b-47f6-b781-1fe56e518e9d req-615077ee-48f3-4ef4-9578-0f04174c70da tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0828261 Dec 14 03:28:55.357496 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.provisioning_blocks [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Transition to ACTIVE for port object d552dc2f-b498-4237-8e44-bcc35ae08483 will not be triggered until provisioned by entity L2. {{(pid=102571) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 14 03:28:55.365542 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.417292 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Pushing event updated for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:55.485072 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Attempting to bind port d552dc2f-b498-4237-8e44-bcc35ae08483 on host hv-cinder-81803 for vnic_type normal with profile {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 14 03:28:55.485401 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Attempting to bind port d552dc2f-b498-4237-8e44-bcc35ae08483 by drivers openvswitch,hyperv on host hv-cinder-81803 at level 0 using segments [{'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 14 03:28:55.485728 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Attempting to bind port d552dc2f-b498-4237-8e44-bcc35ae08483 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:28:55.490395 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Port d552dc2f-b498-4237-8e44-bcc35ae08483 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81803 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 14 03:28:55.490714 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Attempting to bind port d552dc2f-b498-4237-8e44-bcc35ae08483 on network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 14 03:28:55.495759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Checking agent: {'id': 'd4d1df2c-1796-48e4-a7b5-587c621563b2', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81803', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'started_at': datetime.datetime(2021, 12, 14, 3, 12, 41), 'heartbeat_timestamp': datetime.datetime(2021, 12, 14, 3, 28, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 14 03:28:55.496093 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Checking segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102571) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 14 03:28:55.496501 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Bound using segment: {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'} {{(pid=102571) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 14 03:28:55.496919 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.managers [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Bound port: d552dc2f-b498-4237-8e44-bcc35ae08483, host: hv-cinder-81803, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ad2a459-2b39-4ed4-958c-72bc8ba606a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 257, 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69'}}] {{(pid=102571) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 14 03:28:55.497269 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.564142 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, cleared binding levels {{(pid=102571) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 14 03:28:55.567753 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d552dc2f-b498-4237-8e44-bcc35ae08483,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102571) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 14 03:28:55.572698 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.609652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:55.610274 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.611713 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] 10.222.0.20 "PUT /v2.0/ports/d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 200 len: 1094 time: 0.6694453 Dec 14 03:28:55.612150 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:28:55.614685 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a" -d '{"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:28:55.645062 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d174cef8-91ff-495b-8a7c-0ead5f982d42 service neutron] Pushing event updated for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=3']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:28:55.675593 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:28:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-293d743b-4cfe-4e21-84dc-097fb4daf7da x-openstack-request-id: req-293d743b-4cfe-4e21-84dc-097fb4daf7da {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:28:55.676176 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:28:55.676419 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-293d743b-4cfe-4e21-84dc-097fb4daf7da {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:28:55.676909 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'status': 'completed', 'code': 200} Dec 14 03:28:55.756523 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-430becd6-72ff-4696-8b92-848c29bf1b47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:55.758425 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-430becd6-72ff-4696-8b92-848c29bf1b47 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1097 time: 0.0490754 Dec 14 03:28:55.810375 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:28:55.810955 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-84dee24f-a3a1-4d80-8285-507ff2e1492b service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 200 len: 217 time: 0.0358360 Dec 14 03:28:55.859786 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-782d818e-c23d-4563-8593-309639e83ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:55.861203 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-782d818e-c23d-4563-8593-309639e83ad6 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0427337 Dec 14 03:28:55.912019 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-a20787db-c643-4306-8efd-0b8f2cdf173f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:55.913517 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-a20787db-c643-4306-8efd-0b8f2cdf173f service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442986 Dec 14 03:28:56.001123 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-08c74a66-d1f2-4a61-85e4-16538be77471 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794122 Dec 14 03:28:56.094038 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4bf7276c-22ea-4ded-b341-6f141066b3af req-1c88580f-4526-438d-afd0-fe9fd66264d0 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856860 Dec 14 03:28:56.234241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-0269a22b-ea11-490c-b3b5-16f20926ef98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:56.235633 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-0269a22b-ea11-490c-b3b5-16f20926ef98 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1097 time: 0.0399134 Dec 14 03:28:56.325240 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-91fb89d7-9f9c-4ba3-bc16-ecd9bf77a799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:56.326658 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-91fb89d7-9f9c-4ba3-bc16-ecd9bf77a799 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0839293 Dec 14 03:28:56.365983 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-5a45ca31-4ec1-4f6b-8e00-dad5fc8c6e64 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 200 len: 217 time: 0.0323000 Dec 14 03:28:56.413954 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-1070d33a-ebda-4a34-b2dd-75fd6822982b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:56.415423 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-1070d33a-ebda-4a34-b2dd-75fd6822982b service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0418923 Dec 14 03:28:56.490406 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 req-b18008b2-ef2c-4ea3-8a7b-2d11a348114d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:56.491773 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 req-b18008b2-ef2c-4ea3-8a7b-2d11a348114d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0755036 Dec 14 03:28:56.494039 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-0ffad01d-747a-4236-ba14-75f85a200162 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:56.495371 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-0ffad01d-747a-4236-ba14-75f85a200162 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0712953 Dec 14 03:28:56.590866 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 req-990112e8-3edb-48c0-9f3e-e8c810279c37 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0926673 Dec 14 03:28:56.614854 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-6faceb4b-6275-4d88-aad0-290eb3ce8c3f service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1111898 Dec 14 03:28:56.708117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-47a4e146-9e35-4b1c-ba2e-4a2dcbf031a3 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863438 Dec 14 03:28:57.708202 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac757a34-a37b-4c38-ad37-925357572a13 req-34cae770-a76e-4eb9-8622-1a39746fb0d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:57.709638 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ac757a34-a37b-4c38-ad37-925357572a13 req-34cae770-a76e-4eb9-8622-1a39746fb0d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0485182 Dec 14 03:28:57.757540 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ac757a34-a37b-4c38-ad37-925357572a13 req-c67bbd85-ba0f-434b-a038-083e1d8f0b22 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418944 Dec 14 03:28:58.880484 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cee1f8-9e9a-461a-910c-501d75acd3ab req-c191d113-7d9e-40bd-bb87-2c0def3cfc48 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:28:58.881960 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68cee1f8-9e9a-461a-910c-501d75acd3ab req-c191d113-7d9e-40bd-bb87-2c0def3cfc48 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0564423 Dec 14 03:28:58.931700 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-68cee1f8-9e9a-461a-910c-501d75acd3ab req-8e4da868-4903-4e0b-a322-a83aedb4a7e8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428069 Dec 14 03:29:00.040724 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 req-c0e6b6b3-c921-42ec-a4ed-e30ce13710f9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:00.042153 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 req-c0e6b6b3-c921-42ec-a4ed-e30ce13710f9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0468328 Dec 14 03:29:00.089340 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 req-7a395a93-d529-4e4e-8307-9ca1ab53f7db tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407772 Dec 14 03:29:01.202496 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b37657-d54e-4fdf-b25e-146961f52408 req-c9e167e6-6f54-4315-9c74-cb8fb9682393 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:01.203987 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70b37657-d54e-4fdf-b25e-146961f52408 req-c9e167e6-6f54-4315-9c74-cb8fb9682393 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0480778 Dec 14 03:29:01.255550 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70b37657-d54e-4fdf-b25e-146961f52408 req-4c7bb075-089f-4087-a51d-9a1587a288fb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457423 Dec 14 03:29:02.366988 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e8791b-ee38-4aec-82b0-327f51d239bb req-ff670253-9332-4587-bfd2-82f589890051 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:02.368452 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75e8791b-ee38-4aec-82b0-327f51d239bb req-ff670253-9332-4587-bfd2-82f589890051 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0473323 Dec 14 03:29:02.415020 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75e8791b-ee38-4aec-82b0-327f51d239bb req-81ca0c51-5817-4400-9deb-c6a6211fd644 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408082 Dec 14 03:29:03.524740 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b6c48e-585e-47e7-8177-b49318380f0d req-e0a7278d-2e79-44d0-978e-89b265a5dd5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:03.526169 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-63b6c48e-585e-47e7-8177-b49318380f0d req-e0a7278d-2e79-44d0-978e-89b265a5dd5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0474129 Dec 14 03:29:03.572845 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-63b6c48e-585e-47e7-8177-b49318380f0d req-e6dafbe6-56a7-4b64-aeef-be9b80deeb16 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409515 Dec 14 03:29:04.686804 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 req-5941dcb8-abc2-4cf1-ae5d-b5ca0e204a35 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:04.688294 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 req-5941dcb8-abc2-4cf1-ae5d-b5ca0e204a35 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0509634 Dec 14 03:29:04.736042 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 req-8f9aabf2-b8ab-43e7-a372-c58697cfe075 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418825 Dec 14 03:29:05.845473 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c460470-92d8-4194-a972-03e6259c0f88 req-5cda6512-3df1-46ab-8592-9dcd462e4ced tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:05.846897 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5c460470-92d8-4194-a972-03e6259c0f88 req-5cda6512-3df1-46ab-8592-9dcd462e4ced tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 944 time: 0.0461709 Dec 14 03:29:05.894329 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5c460470-92d8-4194-a972-03e6259c0f88 req-c88f8084-8f19-41a3-b0b8-c70b86b8b401 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417011 Dec 14 03:29:05.904917 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device d552dc2f-b498-4237-8e44-bcc35ae08483 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:29:05.995475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d552dc2f-b498-4237-8e44-bcc35ae08483,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:29:06.006867 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'port_id': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'mac_address': 'fa:16:3e:8c:7c:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 257, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:29:06.044681 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:06.056920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d552dc2f-b498-4237-8e44-bcc35ae08483 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:29:06.077420 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d552dc2f-b498-4237-8e44-bcc35ae08483,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:29:06.081070 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:06.125386 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=4']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:29:06.132164 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.132510 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.132870 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.133241 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.133601 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.133927 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.134252 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.134573 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.134894 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.135242 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.135562 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.135877 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.136198 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:06.519473 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['d552dc2f-b498-4237-8e44-bcc35ae08483'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:29:07.007958 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c73830-bf68-4313-abfc-a154fce293a9 req-b267bb74-2525-4dd1-bedc-71da82bc9ac4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:07.009373 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96c73830-bf68-4313-abfc-a154fce293a9 req-b267bb74-2525-4dd1-bedc-71da82bc9ac4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 945 time: 0.0493922 Dec 14 03:29:07.056406 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-96c73830-bf68-4313-abfc-a154fce293a9 req-b8b6890a-0043-44c7-8965-53094573af0a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406706 Dec 14 03:29:07.905102 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device d552dc2f-b498-4237-8e44-bcc35ae08483 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:29:07.952925 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning for port d552dc2f-b498-4237-8e44-bcc35ae08483 completed by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 14 03:29:07.956605 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port d552dc2f-b498-4237-8e44-bcc35ae08483 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:29:07.956972 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:08.032552 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:08.054235 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:29:08.056461 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f768b900-5d1d-41c9-b399-27807f0ec359" -d '{"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-plugged", "status": "completed", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:29:08.068700 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d552dc2f-b498-4237-8e44-bcc35ae08483,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:29:08.072612 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:08.097018 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:29:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 x-openstack-request-id: req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:29:08.097308 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-plugged", "status": "completed", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:29:08.097564 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:29:08.097952 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'code': 200} Dec 14 03:29:08.122757 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=5']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:29:08.171873 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-586f9d55-a725-4928-b2ed-62e96e96e512 req-3b3669d0-5398-4b86-b065-d763d28e543e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:08.173329 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-586f9d55-a725-4928-b2ed-62e96e96e512 req-3b3669d0-5398-4b86-b065-d763d28e543e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0489907 Dec 14 03:29:08.220761 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-586f9d55-a725-4928-b2ed-62e96e96e512 req-5943e16b-2bec-490a-8509-f5e62d56c9f7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415163 Dec 14 03:29:08.382015 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9077149f-4f42-4e3c-8f23-e5e3c965cdee req-54ac7fce-5d68-4156-8e1a-623ecf905b04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:08.383535 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9077149f-4f42-4e3c-8f23-e5e3c965cdee req-54ac7fce-5d68-4156-8e1a-623ecf905b04 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1099 time: 0.0398271 Dec 14 03:29:08.433039 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-9077149f-4f42-4e3c-8f23-e5e3c965cdee req-0399bebe-0b0a-48bd-aff0-20513bd716fe service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404351 Dec 14 03:29:09.332643 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad3a016-97bf-4441-b68e-ff17c1101cdb req-8699563b-894b-4bff-b0a1-7aa067802585 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:09.334074 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4ad3a016-97bf-4441-b68e-ff17c1101cdb req-8699563b-894b-4bff-b0a1-7aa067802585 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0463963 Dec 14 03:29:09.381927 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4ad3a016-97bf-4441-b68e-ff17c1101cdb req-0293d8d8-eceb-4a16-9790-8d6dec326946 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421026 Dec 14 03:29:10.493352 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1456bc05-4378-422c-9986-e26f818682b8 req-25673bb3-3112-4ea8-8a95-79258048b6e1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:10.499489 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1456bc05-4378-422c-9986-e26f818682b8 req-25673bb3-3112-4ea8-8a95-79258048b6e1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0468535 Dec 14 03:29:10.541613 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1456bc05-4378-422c-9986-e26f818682b8 req-b0799103-ad14-46b2-ac7f-48314fa4938d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402479 Dec 14 03:29:10.654791 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97870b6f-e17b-4291-b975-f272ab36d3c6 req-7bf3598f-710b-4243-a4fc-506abd7bbb8a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:10.656243 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97870b6f-e17b-4291-b975-f272ab36d3c6 req-7bf3598f-710b-4243-a4fc-506abd7bbb8a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0499034 Dec 14 03:29:10.703884 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-97870b6f-e17b-4291-b975-f272ab36d3c6 req-727aa39b-2c0a-4abb-9c4b-5165a3de3e35 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416970 Dec 14 03:29:10.725827 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59910) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:29:10.856998 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a87a7001-9ebb-4ff0-b8b3-2b5b85580c60 tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:10.858461 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a87a7001-9ebb-4ff0-b8b3-2b5b85580c60 tempest-TestVolumeBootPattern-1715360948 tempest-TestVolumeBootPattern-1715360948-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1094 time: 0.1316791 Dec 14 03:29:10.861206 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 59916) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:29:10.865586 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.v2.base [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Request body: {'floatingip': {'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'port_id': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102571) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 14 03:29:10.887171 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:10.982720 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:10.985036 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:29:11.079683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_common [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Allocated IP 172.27.3.204 (d05a17b1-467e-47d1-82d5-54575b429fe9/4cd56c41-a067-4663-888d-62ea7a6d5a3d/0975f119-02b7-4c55-922e-5a27f0c22a30) {{(pid=102571) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 14 03:29:11.378154 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:11.415670 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:11.447826 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8763911691987', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:11.483887 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Network d05a17b1-467e-47d1-82d5-54575b429fe9 is already hosted by enough agents. {{(pid=102571) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 14 03:29:11.486683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.base_scheduler [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Resources bound (agent type, host, resource id): {{(pid=102571) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 14 03:29:11.490375 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Received port after_create {{(pid=102571) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 14 03:29:11.514525 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=0975f119-02b7-4c55-922e-5a27f0c22a30,revision_number=1']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:29:11.526583 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.526946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.527316 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.527648 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.527978 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.528299 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.528621 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.528942 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.529258 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.529580 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.529893 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.530207 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.530517 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:29:11.848795 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:11.911877 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:12.055729 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for port, precommit_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:12.060246 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2036809'] for port, after_update {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:12.127146 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event updated for resources: {'Port': ['ID=0975f119-02b7-4c55-922e-5a27f0c22a30,revision_number=2']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:29:12.140156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3728671'] for floatingip, after_create {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:12.239498 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 334e5fb5-3372-4451-804c-7ce3d72ff6fc associated. External IP: 172.27.3.204, port: d552dc2f-b498-4237-8e44-bcc35ae08483. Dec 14 03:29:12.433073 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:29:12.539110 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:29:12.548729 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:29:12.557409 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:12.559473 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:29:12.560139 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:28:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:29:12.587294 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-4800f3c8-67b0-4299-b532-9af54cadc903 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7250624 Dec 14 03:29:12.587876 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:29:12.590725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65d526bd-891f-419e-b994-3fa8641a39c5" -d '{"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:29:12.627478 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:29:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 x-openstack-request-id: req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:29:12.627769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:29:12.628027 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:29:12.628429 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'status': 'completed', 'code': 200} Dec 14 03:29:12.668844 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:29:12.712856 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-9e6b8efe-762d-4e6c-89cf-6f2b1ba6599b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:12.714332 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-9e6b8efe-762d-4e6c-89cf-6f2b1ba6599b service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1099 time: 0.0395679 Dec 14 03:29:12.804601 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-80d63554-bae5-4136-ba8d-ddf23b5455e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:12.806001 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-80d63554-bae5-4136-ba8d-ddf23b5455e6 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0828938 Dec 14 03:29:12.878658 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-a447f932-1f78-4eee-94e7-ec32f54707eb service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 200 len: 1000 time: 0.0626926 Dec 14 03:29:12.890285 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '334e5fb5-3372-4451-804c-7ce3d72ff6fc', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.204', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8c:7c:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:29:11Z', 'updated_at': '2021-12-14T03:29:11Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}, {'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:29:12.915779 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:29:12.924478 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:29:12.925083 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:28:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:29:12.928000 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-d5067974-386d-44b8-9321-cb7a86fdffcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:12.929443 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-d5067974-386d-44b8-9321-cb7a86fdffcc service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0428982 Dec 14 03:29:12.973466 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-f13f102e-a920-4b24-a5c9-b486fd370057 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:12.974929 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-f13f102e-a920-4b24-a5c9-b486fd370057 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383427 Dec 14 03:29:13.027770 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:29:13.069234 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-10c3840c-df57-4e36-9320-48f22a661617 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844796 Dec 14 03:29:13.158697 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-fef84bc6-fb27-451d-8334-33635955cb28 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817544 Dec 14 03:29:13.247230 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '334e5fb5-3372-4451-804c-7ce3d72ff6fc', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.204', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8c:7c:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:29:11Z', 'updated_at': '2021-12-14T03:29:11Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}, {'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:29:13.272530 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-960d212a-0eee-4bc3-b0e2-9056b1bb3b53 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '334e5fb5-3372-4451-804c-7ce3d72ff6fc', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.204', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8c:7c:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:29:11Z', 'updated_at': '2021-12-14T03:29:11Z', 'revision_number': 0, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}, {'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:29:13.448611 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced58b76-6ff0-4e88-bc2d-9f2f25b4df1d None None] New status for floating IP 334e5fb5-3372-4451-804c-7ce3d72ff6fc: ACTIVE {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:29:19.703174 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-054b19ef-adfd-4117-805e-7dd75ff0bd6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:21.896034 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-9b5dd5ea-d617-479d-9c14-5ad0607c74b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:23.632796 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:24.650546 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:25.812702 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:41.374672 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:47.983275 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:29:49.704302 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ec7f7339-e7c1-4947-a8c6-ef316737715c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:50.287677 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-32c0a591-d281-4f48-88be-24c68affaed1 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0379407 Dec 14 03:29:50.363112 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-f56e4e7d-2ede-43dc-8f42-1202b515adb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:50.364858 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-f56e4e7d-2ede-43dc-8f42-1202b515adb7 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0437422 Dec 14 03:29:50.464433 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-a32c0769-0255-4f11-a0d1-2a250fbd8f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:50.465887 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-a32c0769-0255-4f11-a0d1-2a250fbd8f25 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0827162 Dec 14 03:29:50.532368 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-80c51913-f22a-49b4-ab84-1eeceac342a2 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 1000 time: 0.0588622 Dec 14 03:29:50.579805 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-dc26622f-4d89-44c3-944a-9112b7eff094 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:50.581179 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-dc26622f-4d89-44c3-944a-9112b7eff094 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0417404 Dec 14 03:29:50.624649 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-736cb7a4-22a2-4937-ab94-496e8bcc2817 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:29:50.626065 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-736cb7a4-22a2-4937-ab94-496e8bcc2817 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383434 Dec 14 03:29:50.716655 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-54ce565f-debc-41d1-9c22-2b6777cf6825 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837181 Dec 14 03:29:50.803622 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-1bbf27f4-db8b-4b5f-a1b0-30d4c4659345 req-8402e17e-23dc-4c8d-9a05-f71df5f1013f service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794849 Dec 14 03:29:51.896147 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-0ed27a3f-2a5a-42d9-90a5-c61d1aa74309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:53.634685 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:54.652840 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:29:55.813699 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:10.094622 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [req-df71e792-359d-481c-a6e9-c6179e6b77b3 req-ca6b3043-05f5-4a00-85ea-44c6d9f2bc9a service neutron] (102572) timed out ('10.222.0.20', 53459) {{(pid=102572) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 14 03:30:11.408384 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:19.707977 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5fbdb98b-fb4a-41bf-b63b-e0707ed120da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:21.897370 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ff288df4-91bc-4339-84eb-523a0527004a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:23.638143 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:24.654338 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:24.983130 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:30:25.818457 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:41.422809 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:43.134130 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99e778c-6011-4f6a-8208-f83aec88b6c9 req-d860841a-f4f6-4173-8d3d-9f3d4a8007ba tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:43.136198 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a99e778c-6011-4f6a-8208-f83aec88b6c9 req-d860841a-f4f6-4173-8d3d-9f3d4a8007ba tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.1251969 Dec 14 03:30:43.188137 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a99e778c-6011-4f6a-8208-f83aec88b6c9 req-8f825d39-3a9a-41dd-a2fd-bc75f1f0dfa0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459690 Dec 14 03:30:44.349560 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff990954-62c0-40dd-ba7e-65876c74f206 req-85bce033-db1f-436b-9508-7e3ba87ef2a9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:44.351000 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ff990954-62c0-40dd-ba7e-65876c74f206 req-85bce033-db1f-436b-9508-7e3ba87ef2a9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0940456 Dec 14 03:30:44.398856 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-ff990954-62c0-40dd-ba7e-65876c74f206 req-3d1b099c-2d45-4df5-8216-d5f1cc3907ce tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412560 Dec 14 03:30:45.510995 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aadefaa5-f2f8-4556-a339-b3db5863a139 req-2828b2bf-c63a-47a6-90f8-b7df3d503e60 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:45.512457 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aadefaa5-f2f8-4556-a339-b3db5863a139 req-2828b2bf-c63a-47a6-90f8-b7df3d503e60 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0472898 Dec 14 03:30:45.559984 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aadefaa5-f2f8-4556-a339-b3db5863a139 req-454d58c0-9e52-498b-bb50-ab3eefd550aa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418019 Dec 14 03:30:46.676651 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db req-2ffd0203-010b-4a6a-8e54-8c70d99c098d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:46.678098 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db req-2ffd0203-010b-4a6a-8e54-8c70d99c098d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0513158 Dec 14 03:30:46.725335 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db req-3a9e3c93-83ad-4853-aafa-d292c7853a25 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413988 Dec 14 03:30:47.848119 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 req-2d51d6ee-2bfe-4d38-920a-f495f591e18d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:47.849587 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 req-2d51d6ee-2bfe-4d38-920a-f495f591e18d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0565469 Dec 14 03:30:47.897220 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 req-88d607a3-1701-4155-8e7a-d860adab258f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416973 Dec 14 03:30:49.007610 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 req-3f17d8fb-55e8-4de9-8060-b58ecfcfebfa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:49.009021 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 req-3f17d8fb-55e8-4de9-8060-b58ecfcfebfa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0465760 Dec 14 03:30:49.059890 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 req-b161ffe6-7002-4c49-a5cc-760c1529568e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450339 Dec 14 03:30:49.709826 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-71f41595-7e3c-42a5-92f5-546faa63895e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:50.171809 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc req-53e00168-82a6-4011-b6e7-44f3be351acc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:50.173312 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc req-53e00168-82a6-4011-b6e7-44f3be351acc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0464103 Dec 14 03:30:50.221810 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc req-8ccd2882-2a66-4f36-8c66-cbef1c6d3f65 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422227 Dec 14 03:30:51.365033 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3308a274-4917-4e62-8c0d-d55aebd44499 req-7c809fc8-f8d2-451f-8c74-7f82085911d6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:51.366490 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3308a274-4917-4e62-8c0d-d55aebd44499 req-7c809fc8-f8d2-451f-8c74-7f82085911d6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0797591 Dec 14 03:30:51.373245 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-0c4f9e77-8421-4725-87d8-61c9509b4b17 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0997424 Dec 14 03:30:51.417224 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-3308a274-4917-4e62-8c0d-d55aebd44499 req-78e740e5-bf56-4870-b2cf-a05efaea21a3 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429389 Dec 14 03:30:51.476137 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-32fa730d-051a-4a7a-83c5-215f71691e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:51.477586 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-32fa730d-051a-4a7a-83c5-215f71691e6a service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0401947 Dec 14 03:30:51.579564 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-f3bde38a-0131-40f0-8106-4e576be053ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:51.580997 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-f3bde38a-0131-40f0-8106-4e576be053ce service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.0838592 Dec 14 03:30:51.663769 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-0c2cc868-0ad9-4cd1-8d0c-04a059741abf service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 1000 time: 0.0572572 Dec 14 03:30:51.714453 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-d510be70-d37d-4ac3-8d51-45975c2c773d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:51.715849 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-d510be70-d37d-4ac3-8d51-45975c2c773d service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0425436 Dec 14 03:30:51.764641 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-537a683e-47ef-4c11-8e52-8ec9b0a1c0f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:51.766077 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-537a683e-47ef-4c11-8e52-8ec9b0a1c0f2 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430312 Dec 14 03:30:51.850845 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-1aa078c9-9895-48ef-8cf3-3b46581390e0 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0775397 Dec 14 03:30:51.899031 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-75aecf23-02f3-4f20-93f5-b8ba72f7674c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:51.942058 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-32bce5c3-b99c-4145-8a97-7d4e17856320 req-848d8a97-cafa-4d1a-9699-a485411e811b service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843287 Dec 14 03:30:52.532388 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0aaea7d-d60c-4614-838f-d16071811880 req-28c58158-957c-4d58-82bc-bb1cf482fa8a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:52.533804 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0aaea7d-d60c-4614-838f-d16071811880 req-28c58158-957c-4d58-82bc-bb1cf482fa8a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0478680 Dec 14 03:30:52.580882 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b0aaea7d-d60c-4614-838f-d16071811880 req-23082363-677c-44a0-bcd7-a5b73bef4ede tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412929 Dec 14 03:30:53.309288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-c2a79099-012a-4fce-8806-9d34cd16776c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:53.310744 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-c2a79099-012a-4fce-8806-9d34cd16776c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0390866 Dec 14 03:30:53.400759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-a88bba87-fde4-4a13-b978-42723bf09c52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:53.402163 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-a88bba87-fde4-4a13-b978-42723bf09c52 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0839090 Dec 14 03:30:53.465198 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-44d58c90-0e0f-4d85-961e-9378d68665fd service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 1000 time: 0.0559306 Dec 14 03:30:53.512374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-8fea2d2d-d519-4575-8a6f-40fb87356d3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:53.513706 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-8fea2d2d-d519-4575-8a6f-40fb87356d3f service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0411274 Dec 14 03:30:53.560445 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-8a31e03c-4915-4b34-b80e-d4d61341044a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:53.561766 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-8a31e03c-4915-4b34-b80e-d4d61341044a service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408878 Dec 14 03:30:53.639742 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:53.650819 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-894e00b7-8c5b-4cc6-8c93-aa3b4d232363 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813096 Dec 14 03:30:53.975868 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70905f97-ec54-4261-b375-5f46a652ec92 req-f97beb7b-fbb8-4c7a-83e1-a8d1ddc4f734 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:53.977226 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70905f97-ec54-4261-b375-5f46a652ec92 req-f97beb7b-fbb8-4c7a-83e1-a8d1ddc4f734 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.3255384 Dec 14 03:30:54.020117 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a req-2f584b93-44a1-498f-a523-cdeee37d4423 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3604662 Dec 14 03:30:54.043139 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-70905f97-ec54-4261-b375-5f46a652ec92 req-b104f87f-c552-4bf6-a9b0-d3aa08dacf3d tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558946 Dec 14 03:30:54.657513 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:55.158706 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd97f27-fbe4-4938-806e-c167d5bf34cc req-3ce9dc25-95b4-4bfd-8365-0b6d3ff1d981 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:55.160173 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2cd97f27-fbe4-4938-806e-c167d5bf34cc req-3ce9dc25-95b4-4bfd-8365-0b6d3ff1d981 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0508568 Dec 14 03:30:55.207493 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2cd97f27-fbe4-4938-806e-c167d5bf34cc req-d96dc601-8eea-4cdf-99f2-0964931fd1ac tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409148 Dec 14 03:30:55.820773 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:56.322625 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe req-b09c0c3a-e373-4787-96ba-25cc6afa3787 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:56.324147 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe req-b09c0c3a-e373-4787-96ba-25cc6afa3787 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0479977 Dec 14 03:30:56.373591 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe req-2bc29531-adb1-4939-a095-30b1b9dafbf6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427005 Dec 14 03:30:57.485241 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fbce58-58f9-4867-9cf4-12f646f9809b req-bf79e1ef-6e44-4d09-91b4-1dc500f2efdf tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:57.486682 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8fbce58-58f9-4867-9cf4-12f646f9809b req-bf79e1ef-6e44-4d09-91b4-1dc500f2efdf tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0476687 Dec 14 03:30:57.536995 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c8fbce58-58f9-4867-9cf4-12f646f9809b req-dc45701c-a09d-4e55-a1a5-833609f94380 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441735 Dec 14 03:30:57.739950 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b507f0-f67f-401e-866f-3b09e8255395 req-f5dfbb6e-31c5-4ed2-b48b-759768fef549 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:57.741401 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a8b507f0-f67f-401e-866f-3b09e8255395 req-f5dfbb6e-31c5-4ed2-b48b-759768fef549 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0480070 Dec 14 03:30:57.759379 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-cd72244d-33e9-4df4-b722-588b8c8c007a service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0861440 Dec 14 03:30:57.768998 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-2144187e-7ed2-462e-8075-53831892ba98 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102572) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 14 03:30:57.769963 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-2144187e-7ed2-462e-8075-53831892ba98 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051286 Dec 14 03:30:57.791988 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-a8b507f0-f67f-401e-866f-3b09e8255395 req-614a8a09-692d-4828-be00-72183d464cca tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434160 Dec 14 03:30:58.445665 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:30:58.521173 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:58.543465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:30:58.545723 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66599f07-e106-4a63-b96e-90fdc55c05ad" -d '{"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-unplugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:30:58.558693 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:30:58.564481 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:30:58.587995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 14 Dec 2021 03:30:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 x-openstack-request-id: req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:30:58.588283 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-unplugged", "status": "failed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "code": 422}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:30:58.588537 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:30:58.588983 dv-cinder-818037-8-iscsi neutron-server[102573]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'code': 422} returned with failed status Dec 14 03:30:58.613724 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=6']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:30:58.621511 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.621867 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.622217 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.622650 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.622969 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.623318 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.623657 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.623988 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.624314 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.624647 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.624977 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.625358 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.625673 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:30:58.909652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 req-a46399c8-eac9-4ad7-995b-087ee916b563 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:58.916023 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 req-a46399c8-eac9-4ad7-995b-087ee916b563 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0531409 Dec 14 03:30:58.961802 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 req-8d8a834a-d75e-4546-9484-857200e2b0c0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431910 Dec 14 03:30:59.278673 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-dec36d57-1795-4023-9880-d3e186a68a03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:59.280181 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-dec36d57-1795-4023-9880-d3e186a68a03 service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682&tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a HTTP/1.1" status: 200 len: 1096 time: 0.0705724 Dec 14 03:30:59.351317 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-b1b78514-40a4-477c-8f53-f2ed4cb80389 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:59.352753 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-b1b78514-40a4-477c-8f53-f2ed4cb80389 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1096 time: 0.0383399 Dec 14 03:30:59.441948 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-d5166e55-3fe2-419a-afb3-c969c032fbb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:59.443444 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-d5166e55-3fe2-419a-afb3-c969c032fbb3 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0842037 Dec 14 03:30:59.507980 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-788074e4-0534-440d-9815-9beca6cbb054 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 998 time: 0.0576270 Dec 14 03:30:59.555846 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-fafb4cbf-b138-4361-b258-bf60085c7e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:59.557206 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-fafb4cbf-b138-4361-b258-bf60085c7e24 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0418527 Dec 14 03:30:59.606389 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-fb823acb-0274-4deb-923c-ef90f8e2b21f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:30:59.607893 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-fb823acb-0274-4deb-923c-ef90f8e2b21f service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430434 Dec 14 03:30:59.694088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-2a10aaed-2f19-466a-b994-cc984c6f7fb1 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787508 Dec 14 03:30:59.784076 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be req-8e93f3d8-45de-4a5e-8d78-e90f07d6be17 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826914 Dec 14 03:31:00.075121 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04cbc796-34bd-4eb5-9764-3d8d739ad164 req-543b4f18-0f68-47b8-94a6-74b421944e5f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:00.076558 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-04cbc796-34bd-4eb5-9764-3d8d739ad164 req-543b4f18-0f68-47b8-94a6-74b421944e5f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0475910 Dec 14 03:31:00.123105 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-04cbc796-34bd-4eb5-9764-3d8d739ad164 req-03430b7c-df0d-455f-93ea-9097951b3098 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407782 Dec 14 03:31:01.233235 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fafd7d-0844-4846-8d56-962748e635a4 req-1a955f00-7c20-4343-a660-287b3d1200b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:01.234677 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3fafd7d-0844-4846-8d56-962748e635a4 req-1a955f00-7c20-4343-a660-287b3d1200b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0477593 Dec 14 03:31:01.282732 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f3fafd7d-0844-4846-8d56-962748e635a4 req-689f6af6-c56f-45a5-ae4c-8b1e14358eb9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419710 Dec 14 03:31:01.809229 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60020) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:01.959022 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port 0975f119-02b7-4c55-922e-5a27f0c22a30 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:01.959301 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:01.982151 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:31:02.029954 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:02.030281 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:02.041836 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for 0975f119-02b7-4c55-922e-5a27f0c22a30 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:02.184777 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:02.212510 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=0975f119-02b7-4c55-922e-5a27f0c22a30,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:02.235905 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.236258 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.236723 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.237034 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.237367 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.237806 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.238188 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.238523 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.239119 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.239459 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.239794 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.240111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.240433 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:02.281043 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:02.281379 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 334e5fb5-3372-4451-804c-7ce3d72ff6fc disassociated (deleted). External IP: 172.27.3.204, port: d552dc2f-b498-4237-8e44-bcc35ae08483. Dec 14 03:31:02.396971 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e req-c296e927-f49a-4144-8bfe-a59080963eac tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:02.398420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e req-c296e927-f49a-4144-8bfe-a59080963eac tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0502114 Dec 14 03:31:02.447179 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e req-9873b243-588f-4352-a1b2-e2abd499ba76 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422645 Dec 14 03:31:02.482341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:31:02.852224 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:31:02.856972 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:02.862926 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:31:02.873553 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:02.874259 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:02.885383 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9a1293e5-942a-4cd3-8495-5ec0181d70ca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /v2.0/floatingips/334e5fb5-3372-4451-804c-7ce3d72ff6fc HTTP/1.1" status: 204 len: 168 time: 1.0750766 Dec 14 03:31:02.885967 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:31:02.888249 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb" -d '{"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:31:02.990005 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:31:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd x-openstack-request-id: req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:31:02.990289 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:31:02.990551 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:31:02.990943 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'status': 'completed', 'code': 200} Dec 14 03:31:02.991593 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:03.149378 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17918b1-ba8c-4019-b707-872449b8d0d6 req-69e991bf-5a0e-4741-bf49-497b55e0ea9f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.151461 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d17918b1-ba8c-4019-b707-872449b8d0d6 req-69e991bf-5a0e-4741-bf49-497b55e0ea9f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0823095 Dec 14 03:31:03.153918 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-46934bc3-cc7c-4107-8e5e-baf4b0188377 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.155369 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-46934bc3-cc7c-4107-8e5e-baf4b0188377 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 1099 time: 0.0580721 Dec 14 03:31:03.272650 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-d17918b1-ba8c-4019-b707-872449b8d0d6 req-015d1493-cd9d-433c-b4e2-06eca1e2f0b7 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1148868 Dec 14 03:31:03.303169 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-34219d8e-6934-43a2-bcff-371c05744f97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.304605 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-34219d8e-6934-43a2-bcff-371c05744f97 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.1413531 Dec 14 03:31:03.349532 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-877ac80b-308a-4e54-a9a2-e4c0a78650a5 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 200 len: 217 time: 0.0371194 Dec 14 03:31:03.358585 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:03.387685 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:31:03.395780 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:03.396384 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:03.396945 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-e187ad65-237d-4be4-99ee-8da31a3cf21e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.398370 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-e187ad65-237d-4be4-99ee-8da31a3cf21e service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0418031 Dec 14 03:31:03.443955 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-3c7f0eba-acb6-4b70-9280-b4b5188a3109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.445368 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-3c7f0eba-acb6-4b70-9280-b4b5188a3109 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0384564 Dec 14 03:31:03.501858 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:03.565826 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-196730e2-b97b-4920-982d-5f52078297a1 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1117594 Dec 14 03:31:03.580494 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fbc14da-d930-4f05-87d4-efdfcec8f56c req-897758c4-20af-4de4-b375-d28e37e0f8b2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:03.581963 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2fbc14da-d930-4f05-87d4-efdfcec8f56c req-897758c4-20af-4de4-b375-d28e37e0f8b2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0654483 Dec 14 03:31:03.684350 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2fbc14da-d930-4f05-87d4-efdfcec8f56c req-5edb3308-32c5-4fd2-999f-80c45ef7c62e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0934603 Dec 14 03:31:03.705212 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-b82f2210-5985-4bd0-a1de-e8836562b963 service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222806 Dec 14 03:31:03.727767 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:03.756839 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9166ed66-5af8-41d4-a8de-9c28177e71c6 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_floatingips': [{'id': '9b9cdfa4-2674-4a49-b8ef-6ad469016b79', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'floating_ip_address': '172.27.3.58', 'floating_network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'router_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'port_id': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 662, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'mac_address': 'fa:16:3e:8d:9f:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-14T03:26:36Z', 'updated_at': '2021-12-14T03:26:38Z', 'revision_number': 1, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:31:03.956413 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3617bc1e-85b7-47fd-85fc-46e500ad51aa None None] New status for floating IP 334e5fb5-3372-4451-804c-7ce3d72ff6fc: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:31:04.386072 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeed4747-df11-4820-9de9-4b88399ed3b2 req-b6ee9117-ab7e-4b60-9b64-88ec942d9eb3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:04.387618 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aeed4747-df11-4820-9de9-4b88399ed3b2 req-b6ee9117-ab7e-4b60-9b64-88ec942d9eb3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0474813 Dec 14 03:31:04.435909 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-aeed4747-df11-4820-9de9-4b88399ed3b2 req-dfaa5969-f048-4123-87b1-15a6e4998ad8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418956 Dec 14 03:31:04.797798 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 req-e1684450-467d-47ef-95ac-8fb1b23ea834 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:04.799266 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 req-e1684450-467d-47ef-95ac-8fb1b23ea834 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0468748 Dec 14 03:31:04.846088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 req-5fece4d5-d698-4cd4-9399-36b2939914b0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409603 Dec 14 03:31:04.907716 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-a9a8da7e-35a2-4a7c-8ef6-216a903791d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:04.909116 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-a9a8da7e-35a2-4a7c-8ef6-216a903791d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 946 time: 0.0497518 Dec 14 03:31:04.995705 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port d552dc2f-b498-4237-8e44-bcc35ae08483 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:04.995968 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:05.082779 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] For port d552dc2f-b498-4237-8e44-bcc35ae08483, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=d552dc2f-b498-4237-8e44-bcc35ae08483,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:05.083166 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:05.095067 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for d552dc2f-b498-4237-8e44-bcc35ae08483 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:05.214524 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:05.245480 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=d552dc2f-b498-4237-8e44-bcc35ae08483,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:05.257081 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.257425 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.257770 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.258101 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.258437 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.258770 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.259183 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.260100 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.260441 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.260825 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.261156 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.261483 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.261805 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:31:05.295438 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] No DVR routers for this DVR port d552dc2f-b498-4237-8e44-bcc35ae08483 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:31:05.297848 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:05.301234 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-45b882ff-815d-4740-ad0a-d5756bf372d5 req-d37d4a75-0fc0-41c7-9fb3-bafef1366fa4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "DELETE /v2.0/ports/d552dc2f-b498-4237-8e44-bcc35ae08483 HTTP/1.1" status: 204 len: 173 time: 0.3850546 Dec 14 03:31:05.301665 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'name': 'network-vif-deleted', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:31:05.303904 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66e18e2c-6147-4d78-a905-fa557125d172" -d '{"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-deleted", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:31:05.342912 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:31:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37722fb0-f27f-48fd-adb0-ffa0399490c6 x-openstack-request-id: req-37722fb0-f27f-48fd-adb0-ffa0399490c6 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:31:05.343295 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-deleted", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:31:05.343543 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-37722fb0-f27f-48fd-adb0-ffa0399490c6 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:31:05.343930 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b8269bb0-71ca-4269-ae95-6ccd9614cf1e', 'name': 'network-vif-deleted', 'tag': 'd552dc2f-b498-4237-8e44-bcc35ae08483', 'status': 'completed', 'code': 200} Dec 14 03:31:05.530637 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f545e974-6dd6-4aa8-ab73-371b11321080 req-a5304cf2-9090-4e17-b3fc-37edcf748fc4 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=b8269bb0-71ca-4269-ae95-6ccd9614cf1e HTTP/1.1" status: 200 len: 210 time: 0.0255005 Dec 14 03:31:05.958478 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209eed4e-afd6-49d0-b32a-ade51e3655fd req-1b3848b6-5532-4fe4-84f1-8146d8a16933 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:05.959992 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-209eed4e-afd6-49d0-b32a-ade51e3655fd req-1b3848b6-5532-4fe4-84f1-8146d8a16933 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0474558 Dec 14 03:31:06.012628 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-209eed4e-afd6-49d0-b32a-ade51e3655fd req-5109efcd-c181-4546-9696-05c8567a8433 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462058 Dec 14 03:31:07.124769 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b598005f-a19d-4f48-a8e2-af457002adee req-80544893-6594-4ad7-a52e-bcbf14001ca0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:07.126114 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b598005f-a19d-4f48-a8e2-af457002adee req-80544893-6594-4ad7-a52e-bcbf14001ca0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0467386 Dec 14 03:31:07.173699 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-b598005f-a19d-4f48-a8e2-af457002adee req-ecda0c45-1fe7-431c-ad2d-86f89f655b3c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418260 Dec 14 03:31:08.285959 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc req-2b47245c-e809-42d0-ad15-17c337646f74 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:08.287428 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc req-2b47245c-e809-42d0-ad15-17c337646f74 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 943 time: 0.0476406 Dec 14 03:31:08.334357 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc req-20685f6a-861d-4d67-8b12-f516f80a4c10 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410948 Dec 14 03:31:08.524832 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 details requested by agent hyperv_hv-cinder-81803 with host hv-cinder-81803 {{(pid=102573) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 14 03:31:08.534703 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device d552dc2f-b498-4237-8e44-bcc35ae08483 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:08.556967 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: d552dc2f-b498-4237-8e44-bcc35ae08483 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:08.558170 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device d552dc2f-b498-4237-8e44-bcc35ae08483 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:08.637696 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:08.648303 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Returning: {'device': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'port_id': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'mac_address': 'fa:16:3e:f1:16:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 295, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102573) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 14 03:31:08.684366 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:08.696826 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f5625fc9-aa99-4f98-9a5d-b0f54296bb68 {{(pid=102573) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 14 03:31:08.715446 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:08.719090 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:08.763644 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=7']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:08.801531 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60062) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:08.949713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port 87f623f2-ca5e-4ed5-831b-315db2b717a3 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:08.950048 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.020716 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.021037 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.032598 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for 87f623f2-ca5e-4ed5-831b-315db2b717a3 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:09.141796 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] get_ports_and_sgs() called for port_ids ['f5625fc9-aa99-4f98-9a5d-b0f54296bb68'] {{(pid=102573) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 14 03:31:09.175529 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.202838 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=87f623f2-ca5e-4ed5-831b-315db2b717a3,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:09.261768 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.262102 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.db.l3_db [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Floating IP 9b9cdfa4-2674-4a49-b8ef-6ad469016b79 disassociated (deleted). External IP: 172.27.3.58, port: 15eacb4a-a968-4c7a-8e62-e27f90bfd84e. Dec 14 03:31:09.449976 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a28adbc-2de3-4d6b-bd5a-743327ee346b req-0897e2b2-ba1e-4a78-8e44-371a78614a20 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:09.451362 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4a28adbc-2de3-4d6b-bd5a-743327ee346b req-0897e2b2-ba1e-4a78-8e44-371a78614a20 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 944 time: 0.0506873 Dec 14 03:31:09.467991 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:31:09.499289 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4a28adbc-2de3-4d6b-bd5a-743327ee346b req-67126023-dff9-4135-a712-aeb9ca4f845f tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417657 Dec 14 03:31:09.573276 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:31:09.578012 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:09.582545 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:31:09.592721 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:09.593334 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:09.604957 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a92714b9-efc2-4a97-abcc-6e6624ca1b39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /v2.0/floatingips/9b9cdfa4-2674-4a49-b8ef-6ad469016b79 HTTP/1.1" status: 204 len: 168 time: 0.8023708 Dec 14 03:31:09.605542 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e'}] {{(pid=102572) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:31:09.607806 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7b658bf0b80f6715476452bf5f2a9b30505031ae607ba2f838d6fb2d24a4290f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7bf74ac3-7a80-46e5-8865-0748a397a982" -d '{"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]}' {{(pid=102572) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:31:09.644825 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:31:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ac66a64-952e-493f-aca4-f288e0c96ef5 x-openstack-request-id: req-4ac66a64-952e-493f-aca4-f288e0c96ef5 {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:31:09.645108 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e", "status": "completed", "code": 200}]} {{(pid=102572) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:31:09.645359 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4ac66a64-952e-493f-aca4-f288e0c96ef5 {{(pid=102572) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:31:09.645756 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'status': 'completed', 'code': 200} Dec 14 03:31:09.707431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:09.740480 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-62b2a9c6-93fd-4c64-8d94-0e4217f351ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:09.742478 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-62b2a9c6-93fd-4c64-8d94-0e4217f351ed service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 1098 time: 0.0500014 Dec 14 03:31:09.873035 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f846ef8b-b341-478c-8176-573a39bb80d2 req-3126bb29-91d1-49b3-b12f-cf7162a9e098 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:09.874489 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f846ef8b-b341-478c-8176-573a39bb80d2 req-3126bb29-91d1-49b3-b12f-cf7162a9e098 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0969379 Dec 14 03:31:09.906728 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:09.927216 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-fee56fbe-06f3-490b-9542-56003bbf6a60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:09.928646 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-fee56fbe-06f3-490b-9542-56003bbf6a60 service neutron] 10.222.0.20 "GET /v2.0/networks?id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 200 len: 913 time: 0.1270037 Dec 14 03:31:09.932814 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:31:09.941161 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:09.941771 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:09.948920 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f846ef8b-b341-478c-8176-573a39bb80d2 req-e8ebe0c3-658d-46fa-be29-754eb4149534 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0684681 Dec 14 03:31:09.991497 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-ac00ee6f-ad55-49e8-8b2a-b6fbf4539547 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 200 len: 217 time: 0.0533104 Dec 14 03:31:10.046770 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:10.049383 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-459de521-2de5-473b-a52b-09d35b97ead3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:10.050940 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-459de521-2de5-473b-a52b-09d35b97ead3 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 200 len: 851 time: 0.0509048 Dec 14 03:31:10.096889 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-546acae2-dc1a-42c8-801a-3dc45b03fca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:10.098393 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-546acae2-dc1a-42c8-801a-3dc45b03fca6 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=8f2d77d5-e58c-4a97-8899-5e1a2da29f69&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0385025 Dec 14 03:31:10.189670 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-9efb1912-bde4-4f3e-b48e-a3f90db63a1c service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826066 Dec 14 03:31:10.241982 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:10.280337 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-a5a152f5-dc7d-4648-bf54-86be1674e93d service neutron] 10.222.0.20 "GET /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827761 Dec 14 03:31:10.389801 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a951231-6b70-45a8-923a-4f3c666ce88b None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:51Z', 'revision_number': 4, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '49cdd42c-ecfc-4c8b-b86c-377c97e3f097', 'name': '', 'network_id': '8f2d77d5-e58c-4a97-8899-5e1a2da29f69', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'mac_address': 'fa:16:3e:92:f9:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:51Z', 'updated_at': '2021-12-14T03:22:56Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'subnets': [{'id': '65e7eca5-15ea-4dff-9d54-58e7ea8d10a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:31:10.541010 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 up at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 14 03:31:10.593371 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.provisioning_blocks [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Provisioning complete for port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 triggered by entity L2. {{(pid=102573) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 14 03:31:10.593919 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3482775'] for port, provisioning_complete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:10.616189 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ace7b1dc-f404-49b6-abf6-c3f7f1032ca0 None None] New status for floating IP 9b9cdfa4-2674-4a49-b8ef-6ad469016b79: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:31:10.620779 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2376a428-7026-409c-a6cf-1dfb066d1c79 req-dff40d21-bcea-49f5-bc99-e8228caf855e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:10.622367 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2376a428-7026-409c-a6cf-1dfb066d1c79 req-dff40d21-bcea-49f5-bc99-e8228caf855e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 944 time: 0.0526290 Dec 14 03:31:10.681522 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-577382'] for port, before_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:10.684881 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-2376a428-7026-409c-a6cf-1dfb066d1c79 req-0cc4a8c1-1926-4b74-b2a2-60c6ffd3c019 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565577 Dec 14 03:31:10.705154 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102573) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:31:10.707411 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0ac3f43d985ffa43287c0eba42c902a0edb00edbe45d37a87282fd29a62f5ae9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-121ea182-9845-49c3-8ac3-19a8351ff87f" -d '{"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102573) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:31:10.720794 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:10.726441 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8763912258789', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8763911692005', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8763911692023'] for port, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:10.749633 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:31:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bfe2d50-2558-47a5-9132-227ece69d250 x-openstack-request-id: req-4bfe2d50-2558-47a5-9132-227ece69d250 {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:31:10.749865 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "code": 200}]} {{(pid=102573) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:31:10.750117 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4bfe2d50-2558-47a5-9132-227ece69d250 {{(pid=102573) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:31:10.750497 dv-cinder-818037-8-iscsi neutron-server[102573]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'code': 200} Dec 14 03:31:10.774844 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Pushing event updated for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=8']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:11.067306 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab2af12-1560-4c64-abec-3e9ccb20153b req-75fdd51c-69ad-4441-9274-bacef6690dec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:11.068780 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cab2af12-1560-4c64-abec-3e9ccb20153b req-75fdd51c-69ad-4441-9274-bacef6690dec service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0683043 Dec 14 03:31:11.079354 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338b35db-3e8d-4af0-a528-55f51c3d4c0b req-434f4c85-e88d-48fa-bf1f-da06fa9c083b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:11.080737 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-338b35db-3e8d-4af0-a528-55f51c3d4c0b req-434f4c85-e88d-48fa-bf1f-da06fa9c083b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0567515 Dec 14 03:31:11.149517 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-cab2af12-1560-4c64-abec-3e9ccb20153b req-6bd5e4e9-737e-4906-a073-bcfcb5ecb9bf service neutron] 10.222.0.20 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678663 Dec 14 03:31:11.154823 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-338b35db-3e8d-4af0-a528-55f51c3d4c0b req-dc745c25-26f0-4232-86a5-f1292eeea640 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/security-groups?id=aa81265e-19a7-4c76-ae75-2b53568fe438&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0681653 Dec 14 03:31:11.426189 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:11.800861 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76111303-dd05-4617-b3f0-e5487c53e272 req-aebb2fc0-4e6b-4519-8dea-a9476e77335e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:11.802299 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76111303-dd05-4617-b3f0-e5487c53e272 req-aebb2fc0-4e6b-4519-8dea-a9476e77335e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0495961 Dec 14 03:31:11.849485 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-76111303-dd05-4617-b3f0-e5487c53e272 req-9652b295-2412-49bf-b6fe-df11166e3b38 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408232 Dec 14 03:31:11.913653 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-a17d17e8-03e4-4138-a8a5-1328e97f3e6f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:11.915082 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-a17d17e8-03e4-4138-a8a5-1328e97f3e6f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 945 time: 0.0469167 Dec 14 03:31:12.000288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:12.000557 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:12.086445 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] For port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:12.086801 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:12.099490 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for 15eacb4a-a968-4c7a-8e62-e27f90bfd84e owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:12.231394 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:12.253217 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c req-bb8d30b4-2686-4cc6-aa30-db8bca5d0016 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /v2.0/ports?device_id=c2f38df0-5498-4c35-8e93-0221c7e54271 HTTP/1.1" status: 200 len: 210 time: 0.0328481 Dec 14 03:31:12.273172 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=15eacb4a-a968-4c7a-8e62-e27f90bfd84e,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:12.317005 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] No DVR routers for this DVR port 15eacb4a-a968-4c7a-8e62-e27f90bfd84e on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:31:12.319502 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:12.322954 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 req-8b77397d-3d22-4232-ae6a-83f26e243935 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.20 "DELETE /v2.0/ports/15eacb4a-a968-4c7a-8e62-e27f90bfd84e HTTP/1.1" status: 204 len: 173 time: 0.4014974 Dec 14 03:31:12.323496 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'name': 'network-vif-deleted', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:31:12.326194 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68556a6e-3cd5-45c8-a8c4-e86e085c1776" -d '{"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-deleted", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:31:12.367921 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:31:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdc0689e-3f1e-4907-a978-1f14ce260205 x-openstack-request-id: req-cdc0689e-3f1e-4907-a978-1f14ce260205 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:31:12.368210 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-deleted", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:31:12.368454 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-cdc0689e-3f1e-4907-a978-1f14ce260205 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:31:12.368844 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2f38df0-5498-4c35-8e93-0221c7e54271', 'name': 'network-vif-deleted', 'tag': '15eacb4a-a968-4c7a-8e62-e27f90bfd84e', 'status': 'completed', 'code': 200} Dec 14 03:31:12.963632 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0087da00-94de-4187-87a5-3afbab232fd6 req-65d978c8-d470-4b64-b113-1f07466b13ad tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:12.965049 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0087da00-94de-4187-87a5-3afbab232fd6 req-65d978c8-d470-4b64-b113-1f07466b13ad tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0467677 Dec 14 03:31:13.012181 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-0087da00-94de-4187-87a5-3afbab232fd6 req-80f33d51-8e94-4904-8853-21167c0c973e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413065 Dec 14 03:31:13.307475 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60090) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:13.428939 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Deleting port abc58b56-3e2c-4bd0-a23a-df172cc00030 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:13.429278 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.502237 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.502562 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.514260 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling delete_port for abc58b56-3e2c-4bd0-a23a-df172cc00030 owned by network:floatingip {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:13.641552 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.666830 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'Port': ['ID=abc58b56-3e2c-4bd0-a23a-df172cc00030,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:13.727410 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for floatingip, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.730080 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:13.731241 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-c6326af1-d0be-4303-8f0b-c5ac9a57733b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /v2.0/floatingips/0420008b-d84b-485a-9af4-6526ba1176e5 HTTP/1.1" status: 204 len: 168 time: 0.4227662 Dec 14 03:31:14.555466 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 15eacb4a-a968-4c7a-8e62-e27f90bfd84e no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:14.577527 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: 15eacb4a-a968-4c7a-8e62-e27f90bfd84e {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:14.577860 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device 15eacb4a-a968-4c7a-8e62-e27f90bfd84e not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:14.915495 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60102) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:14.970068 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:14.994012 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:15.050778 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:15.053341 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:15.054472 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /v2.0/security-groups/aa81265e-19a7-4c76-ae75-2b53568fe438 HTTP/1.1" status: 204 len: 168 time: 0.1379926 Dec 14 03:31:15.064462 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d9bab4e-5018-4869-a4a7-50acb2038108 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa81265e-19a7-4c76-ae75-2b53568fe438,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:16.130775 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60110) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:16.590343 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:16.824866 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Deleting port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:16.825205 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:16.902264 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] For port 49cdd42c-ecfc-4c8b-b86c-377c97e3f097, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:16.902624 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:16.913797 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Calling delete_port for 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 owned by network:router_interface {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:17.095129 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.119849 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Pushing event deleted for resources: {'Port': ['ID=49cdd42c-ecfc-4c8b-b86c-377c97e3f097,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:17.276974 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.479234 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:31:17.581309 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:31:17.586287 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-642168a3-9ccc-40cf-9872-3d7397e7dcab admin admin] 10.222.0.43 "PUT /v2.0/routers/2c2f1865-1495-422f-ac78-ab2defb6e9f3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4544773 Dec 14 03:31:17.588899 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60118) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:17.591654 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Sync routers for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:31:17.601627 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:17.602242 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:17.689209 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.704883 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:17.787285 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.837762 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Deleting port 9186ead8-43ee-4172-ae38-64359eb23762 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:17.838100 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.876172 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53'}], 'enable_snat': True}, 'gw_port_id': '9186ead8-43ee-4172-ae38-64359eb23762', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:31:17Z', 'revision_number': 5, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port': {'id': '9186ead8-43ee-4172-ae38-64359eb23762', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:1a:7c:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:22:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:17.905588 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Checking router: 2c2f1865-1495-422f-ac78-ab2defb6e9f3 for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:31:17.913244 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] For port 9186ead8-43ee-4172-ae38-64359eb23762, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9186ead8-43ee-4172-ae38-64359eb23762,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:17.913605 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:17.913728 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Routers {'2c2f1865-1495-422f-ac78-ab2defb6e9f3'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:17.914321 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:17.925713 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Calling delete_port for 9186ead8-43ee-4172-ae38-64359eb23762 owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:18.004012 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] Set router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 gateway port host: None {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:18.056749 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:31:17Z', 'revision_number': 6, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:18.084487 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b50e08b6-0bd1-4416-879b-3c69cbd6be51 None None] The sync data for ids ['2c2f1865-1495-422f-ac78-ab2defb6e9f3'] in dv-cinder-818037-8-iscsi is: [{'id': '2c2f1865-1495-422f-ac78-ab2defb6e9f3', 'name': 'tempest-TestVolumeBootPattern-1966875039-router', 'tenant_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:49Z', 'updated_at': '2021-12-14T03:31:17Z', 'revision_number': 6, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'gw_port_host': None}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:31:18.091478 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.121033 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Pushing event deleted for resources: {'Port': ['ID=9186ead8-43ee-4172-ae38-64359eb23762,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:18.178214 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.263626 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.265699 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.315519 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.316426 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2c2f1865-1495-422f-ac78-ab2defb6e9f3 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:31:18.320399 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.321552 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-8cb62630-17e2-4042-a693-58f1b3c53594 admin admin] 10.222.0.43 "DELETE /v2.0/routers/2c2f1865-1495-422f-ac78-ab2defb6e9f3 HTTP/1.1" status: 204 len: 168 time: 0.7317278 Dec 14 03:31:18.324109 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60122) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:18.636649 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Deleting subnet 65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:31:18.639620 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.672413 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.748593 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.797636 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.822533 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65e7eca5-15ea-4dff-9d54-58e7ea8d10a5,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:18.824514 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.827736 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-4f80e10d-a752-4817-9772-87e533b865b7 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/65e7eca5-15ea-4dff-9d54-58e7ea8d10a5 HTTP/1.1" status: 204 len: 168 time: 0.5027151 Dec 14 03:31:18.829062 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a894b84-c135-4302-89f0-b1214ff94e3e None None] Network 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:31:18.830194 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60124) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:18.903593 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.922118 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:18.948628 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:18.948975 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 49cdd42c-ecfc-4c8b-b86c-377c97e3f097 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:18.949393 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9186ead8-43ee-4172-ae38-64359eb23762 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:18.963653 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Deleting port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:18.964045 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:18.969454 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 9186ead8-43ee-4172-ae38-64359eb23762 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:18.969803 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9186ead8-43ee-4172-ae38-64359eb23762 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:19.033270 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] For port 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9cd18753-cb37-4507-b3f5-aae0e77d97a7,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:19.033628 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.043058 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] DHCP port deletion for 8f2d77d5-e58c-4a97-8899-5e1a2da29f69 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:31:19.047186 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Calling delete_port for 9cd18753-cb37-4507-b3f5-aae0e77d97a7 owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:19.092698 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Deleting port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 {{(pid=102573) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:19.093081 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.129446 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.142648 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] No DVR routers for this DVR port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:31:19.163185 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] For port 9cd18753-cb37-4507-b3f5-aae0e77d97a7, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=9cd18753-cb37-4507-b3f5-aae0e77d97a7,segment=NetworkSegment(8ad2a459-2b39-4ed4-958c-72bc8ba606a8),segment_id=8ad2a459-2b39-4ed4-958c-72bc8ba606a8)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:19.163544 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.163972 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Pushing event deleted for resources: {'Port': ['ID=9cd18753-cb37-4507-b3f5-aae0e77d97a7,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:19.176755 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Calling delete_port for 9cd18753-cb37-4507-b3f5-aae0e77d97a7 owned by network:dhcp {{(pid=102573) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:19.228645 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.248772 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f2d77d5-e58c-4a97-8899-5e1a2da29f69']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:19.250119 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.258068 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8ad2a459-2b39-4ed4-958c-72bc8ba606a8') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:19.258360 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8ad2a459-2b39-4ed4-958c-72bc8ba606a8') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:19.272476 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.277159 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] Pushing event deleted for resources: {'Port': ['ID=9cd18753-cb37-4507-b3f5-aae0e77d97a7,revision_number=None']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:19.278995 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c156b61a-f107-43ae-8e7e-c8e0976ad40f None None] No DVR routers for this DVR port 9cd18753-cb37-4507-b3f5-aae0e77d97a7 on host dv-cinder-818037-8-iscsi {{(pid=102573) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:31:19.292496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.298919 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Releasing vlan 257 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:31:19.299324 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:31:19.301151 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:31:19.353780 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.358000 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.361205 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] 10.222.0.43 "DELETE /v2.0/networks/8f2d77d5-e58c-4a97-8899-5e1a2da29f69 HTTP/1.1" status: 204 len: 168 time: 0.5301020 Dec 14 03:31:19.364540 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60126) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:19.374293 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64dc71ea-86de-4679-a68e-2a08c23e6f87 admin admin] Pushing event deleted for resources: {'Network': ['ID=8f2d77d5-e58c-4a97-8899-5e1a2da29f69,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:19.696915 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:19.713358 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ddbd43d1-b6cf-43b1-be64-4976b98901ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:20.162529 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Deleting port 62872077-63d5-45d1-b37c-b0b0d440965c {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:20.162858 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:20.236863 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] For port 62872077-63d5-45d1-b37c-b0b0d440965c, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=62872077-63d5-45d1-b37c-b0b0d440965c,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:20.237221 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:20.249699 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Calling delete_port for 62872077-63d5-45d1-b37c-b0b0d440965c owned by network:router_interface {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:20.417531 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:20.441725 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Pushing event deleted for resources: {'Port': ['ID=62872077-63d5-45d1-b37c-b0b0d440965c,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:20.607127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:20.815414 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Router e8b1674d-7093-437b-9aab-b62e35641c46 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:31:20.922125 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:31:20.925786 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9cd18753-cb37-4507-b3f5-aae0e77d97a7 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:20.929993 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60128) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:20.932116 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Sync routers for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:31:20.935719 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-a0c2efc4-3928-4b37-8f09-d4048764f148 admin admin] 10.222.0.43 "PUT /v2.0/routers/e8b1674d-7093-437b-9aab-b62e35641c46/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5697067 Dec 14 03:31:20.944591 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:20.945216 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:20.945673 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 9cd18753-cb37-4507-b3f5-aae0e77d97a7 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:20.946026 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 9cd18753-cb37-4507-b3f5-aae0e77d97a7 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:21.033496 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.050598 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:21.134022 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.185178 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Deleting port 59a5ed28-73fb-4b13-8800-72cd70183ae8 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:21.185521 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.224264 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231'}], 'enable_snat': True}, 'gw_port_id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:31:20Z', 'revision_number': 5, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port': {'id': '59a5ed28-73fb-4b13-8800-72cd70183ae8', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:f2:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 526, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.231', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:22:54Z', 'updated_at': '2021-12-14T03:23:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:21.254308 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Checking router: e8b1674d-7093-437b-9aab-b62e35641c46 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:31:21.262917 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Routers {'e8b1674d-7093-437b-9aab-b62e35641c46'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:31:21.263553 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:30:52Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['e8b1674d-7093-437b-9aab-b62e35641c46'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:21.265272 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] For port 59a5ed28-73fb-4b13-8800-72cd70183ae8, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=59a5ed28-73fb-4b13-8800-72cd70183ae8,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:21.265631 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.276903 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Calling delete_port for 59a5ed28-73fb-4b13-8800-72cd70183ae8 owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:21.346475 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] Set router e8b1674d-7093-437b-9aab-b62e35641c46 gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:31:21.397389 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:31:21Z', 'revision_number': 6, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:21.426191 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c54f66f8-1143-4b29-ba18-c6b3c0624086 None None] The sync data for ids ['e8b1674d-7093-437b-9aab-b62e35641c46'] in dv-cinder-818037-8-iscsi is: [{'id': 'e8b1674d-7093-437b-9aab-b62e35641c46', 'name': 'tempest-TestVolumeBootPattern-1374087834-router', 'tenant_id': '0474e738524046fc9da3b998a6133a0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:22:53Z', 'updated_at': '2021-12-14T03:31:21Z', 'revision_number': 6, 'project_id': '0474e738524046fc9da3b998a6133a0d', 'gw_port_host': None}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:31:21.437758 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.464138 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Pushing event deleted for resources: {'Port': ['ID=59a5ed28-73fb-4b13-8800-72cd70183ae8,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:21.521835 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.609007 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.611059 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.651695 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.652169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Fanout notify agent at l3_agent the message router_deleted on router e8b1674d-7093-437b-9aab-b62e35641c46 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:31:21.656396 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.657461 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-cacd0711-57df-4611-b091-7300fd0d5f5f admin admin] 10.222.0.43 "DELETE /v2.0/routers/e8b1674d-7093-437b-9aab-b62e35641c46 HTTP/1.1" status: 204 len: 168 time: 0.7264838 Dec 14 03:31:21.660056 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60130) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:21.704129 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Deleting subnet 4afceb57-1177-42c8-a230-784269818f59 {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:31:21.707181 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.740018 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.818810 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.871369 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.894306 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4afceb57-1177-42c8-a230-784269818f59,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:21.900173 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.902680 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d92e4a4b-60fe-45da-92b6-70954b83ae3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:21.903517 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-9f144b86-d8ba-44dd-933f-4a1b34ddb8e4 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/4afceb57-1177-42c8-a230-784269818f59 HTTP/1.1" status: 204 len: 168 time: 0.2424147 Dec 14 03:31:21.906952 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60132) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:21.908999 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fdf22a1-0628-4061-a787-cff8c8abe118 None None] Network 0d0ab0fa-c270-4b02-af87-b2dad39d1991 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:31:21.974480 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.026649 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Deleting port 09b5316e-21ba-4c13-b4bf-25a383c67c90 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:31:22.026985 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.086003 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] For port 09b5316e-21ba-4c13-b4bf-25a383c67c90, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=09b5316e-21ba-4c13-b4bf-25a383c67c90,segment=NetworkSegment(b56c903f-07fa-4dc1-91de-97262a061639),segment_id=b56c903f-07fa-4dc1-91de-97262a061639)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:31:22.086365 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.099444 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Calling delete_port for 09b5316e-21ba-4c13-b4bf-25a383c67c90 owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:31:22.174424 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdde1794-abca-43dc-84b9-a00f51a63274 None None] DHCP port deletion for 0d0ab0fa-c270-4b02-af87-b2dad39d1991 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:31:22.186104 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.199628 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-bdde1794-abca-43dc-84b9-a00f51a63274 None None] The port '09b5316e-21ba-4c13-b4bf-25a383c67c90' was deleted {{(pid=102573) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 14 03:31:22.213553 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Pushing event deleted for resources: {'Port': ['ID=09b5316e-21ba-4c13-b4bf-25a383c67c90,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:22.216851 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] No DVR routers for this DVR port 09b5316e-21ba-4c13-b4bf-25a383c67c90 on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:31:22.295381 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.319332 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d0ab0fa-c270-4b02-af87-b2dad39d1991']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:22.328609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b56c903f-07fa-4dc1-91de-97262a061639') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:22.328909 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b56c903f-07fa-4dc1-91de-97262a061639') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:31:22.337912 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.350956 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.357628 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Releasing vlan 270 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:31:22.357985 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:31:22.359693 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:31:22.413464 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.420170 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.423671 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] 10.222.0.43 "DELETE /v2.0/networks/0d0ab0fa-c270-4b02-af87-b2dad39d1991 HTTP/1.1" status: 204 len: 168 time: 0.5165827 Dec 14 03:31:22.435345 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634503f2-ba70-41fd-9990-63210d1f6fd5 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d0ab0fa-c270-4b02-af87-b2dad39d1991,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:22.538553 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60136) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:22.577303 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-bdf0641f-b922-42c2-88cd-cbd93b938609 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d0c4dcf4957d42b896f04f682afeef7b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375676 Dec 14 03:31:22.579739 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60138) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:22.625321 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.645202 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.691288 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.693947 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:22.695143 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fb859d2b-ad0d-4c62-8e95-71a5aec1a0d3 HTTP/1.1" status: 204 len: 168 time: 0.1144412 Dec 14 03:31:22.702631 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f7bb25-8a56-4ec9-9c3b-a2dafc546e09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb859d2b-ad0d-4c62-8e95-71a5aec1a0d3,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:22.894308 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 59a5ed28-73fb-4b13-8800-72cd70183ae8 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:22.913522 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 59a5ed28-73fb-4b13-8800-72cd70183ae8 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:22.913866 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 59a5ed28-73fb-4b13-8800-72cd70183ae8 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:22.914263 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 62872077-63d5-45d1-b37c-b0b0d440965c no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:22.932652 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 62872077-63d5-45d1-b37c-b0b0d440965c {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:22.932990 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 62872077-63d5-45d1-b37c-b0b0d440965c not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:22.933391 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 09b5316e-21ba-4c13-b4bf-25a383c67c90 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:31:22.956680 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 09b5316e-21ba-4c13-b4bf-25a383c67c90 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:31:22.957082 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 09b5316e-21ba-4c13-b4bf-25a383c67c90 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:31:23.003028 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60144) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:23.042209 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-16a59744-6015-4993-a455-75057af07b68 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0474e738524046fc9da3b998a6133a0d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0379641 Dec 14 03:31:23.044481 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60146) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:31:23.092768 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:23.112729 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:23.158961 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:23.161580 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:23.162710 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8293b28b-ad3f-4ef2-8c68-89542a0641a3 HTTP/1.1" status: 204 len: 168 time: 0.1173174 Dec 14 03:31:23.170185 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9704fad1-bb92-4cb9-9173-2d89113cffcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8293b28b-ad3f-4ef2-8c68-89542a0641a3,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:31:23.642548 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:24.661292 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:25.822920 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:38.981732 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:31:41.435340 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:49.715929 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bee4a409-0d75-4e76-bc8e-4fbf691b1121 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:51.896862 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1f4cb971-3188-4095-ab76-5481335ed2c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:52.314190 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-3edea07d-eda7-4f65-9956-c5b91885f01b service neutron] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0375311 Dec 14 03:31:52.385916 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-9179c27d-71ae-41b8-a105-072c966a308c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:52.387393 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-9179c27d-71ae-41b8-a105-072c966a308c service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0391583 Dec 14 03:31:52.491408 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-244716f7-c060-4163-aaaa-5bdb55aec8f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:52.492854 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-244716f7-c060-4163-aaaa-5bdb55aec8f8 service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.0858836 Dec 14 03:31:52.554839 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-002e5ae2-d57e-4b0d-9c56-e9afb4002d50 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 1000 time: 0.0551071 Dec 14 03:31:52.605473 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-223e1bd5-29bb-4eb9-9e3d-5ca94b60c412 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:52.606821 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-223e1bd5-29bb-4eb9-9e3d-5ca94b60c412 service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0452659 Dec 14 03:31:52.651746 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-ecab9b57-af36-47ce-990e-8e734c514936 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:31:52.653182 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-ecab9b57-af36-47ce-990e-8e734c514936 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395353 Dec 14 03:31:52.740741 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-c2a612f0-ceff-4a5e-930b-7311671a107b service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800571 Dec 14 03:31:52.831755 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-75a511db-9a6a-4ab0-a98c-4dbcf5b6ad92 req-b065407d-4a02-4718-9fc3-61d2d9c9c21d service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838280 Dec 14 03:31:53.645422 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:54.661766 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:31:55.824945 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:11.436260 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:15.981863 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:32:19.716797 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-eb07bfe1-d034-4dfc-9a01-17cfca8e16c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:21.897100 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2d11f00d-55b8-4224-8411-9baafd85d4ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:23.647565 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:24.665954 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:25.828879 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:41.449911 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:41.656866 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60162) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:41.983282 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Deleting port 97ef15ad-530f-4b0f-aa81-e98039795378 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:41.983540 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.055315 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.055643 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.066874 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling delete_port for 97ef15ad-530f-4b0f-aa81-e98039795378 owned by network:floatingip {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:42.234787 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.263195 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event deleted for resources: {'Port': ['ID=97ef15ad-530f-4b0f-aa81-e98039795378,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:42.274032 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.274377 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.274716 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.275075 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.275398 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.275727 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.276055 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.276374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.276694 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.277014 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.277331 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.277646 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.277961 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102571) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:42.330992 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for floatingip, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.331336 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.db.l3_db [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Floating IP 413ddf2c-ec60-4647-a5da-730b829ca6b7 disassociated (deleted). External IP: 172.27.3.52, port: f5625fc9-aa99-4f98-9a5d-b0f54296bb68. Dec 14 03:32:42.537113 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Router 6317f851-cf01-4746-8148-5f72c1fcc54f has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:32:42.639494 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:32:42.644328 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for floatingip, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:42.648864 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Sync routers for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:32:42.658249 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:42.658901 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:42.672759 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-b9f00c8e-7c3b-4e94-8e06-899b44a303fa tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "DELETE /v2.0/floatingips/413ddf2c-ec60-4647-a5da-730b829ca6b7 HTTP/1.1" status: 204 len: 168 time: 1.0124562 Dec 14 03:32:42.672759 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:32:42.673666 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee" -d '{"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:32:42.713100 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 14 Dec 2021 03:32:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-434d4199-ffdb-4660-88ec-115445df64f8 x-openstack-request-id: req-434d4199-ffdb-4660-88ec-115445df64f8 {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:32:42.713397 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:32:42.713663 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-434d4199-ffdb-4660-88ec-115445df64f8 {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:32:42.714088 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'status': 'completed', 'code': 200} Dec 14 03:32:42.779331 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:42.821054 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-0596f857-dadf-4345-9076-c71a76b92030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:42.822567 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-0596f857-dadf-4345-9076-c71a76b92030 service neutron] 10.222.0.20 "GET /v2.0/ports?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 1098 time: 0.0617778 Dec 14 03:32:42.958927 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a366dc-ec1b-4b34-9334-74363704de4a req-564f1149-d824-47ae-84a1-4f82d64beddc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:42.960459 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c5a366dc-ec1b-4b34-9334-74363704de4a req-564f1149-d824-47ae-84a1-4f82d64beddc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0987711 Dec 14 03:32:42.980932 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:43.004802 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-b11a837f-a638-4df1-ab9c-19ba40def22a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:43.006246 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-b11a837f-a638-4df1-ab9c-19ba40def22a service neutron] 10.222.0.20 "GET /v2.0/networks?id=1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 200 len: 910 time: 0.1337454 Dec 14 03:32:43.006374 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Checking router: 6317f851-cf01-4746-8148-5f72c1fcc54f for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:32:43.015144 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:43.015750 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:43.060434 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-cd7a27ef-0bd9-4ee6-9cf5-5d88fbc3e339 service neutron] 10.222.0.20 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 200 len: 217 time: 0.0434148 Dec 14 03:32:43.064527 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-c5a366dc-ec1b-4b34-9334-74363704de4a req-98638eca-77dd-4fa2-b3e1-639a12ecfdac tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0976460 Dec 14 03:32:43.109908 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-e24b4ae4-350c-42cc-bbae-c02b4135406e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:43.111415 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-e24b4ae4-350c-42cc-bbae-c02b4135406e service neutron] 10.222.0.20 "GET /v2.0/subnets?id=451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 200 len: 848 time: 0.0437875 Dec 14 03:32:43.118528 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:43.155289 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-d4809288-99fa-4c53-8171-88ec707e9556 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:43.156946 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-d4809288-99fa-4c53-8171-88ec707e9556 service neutron] 10.222.0.20 "GET /v2.0/ports?network_id=1a26c104-e4b3-4523-972d-5602ee9f495b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0381162 Dec 14 03:32:43.248460 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-e798f01f-f202-45d5-8ede-bda05293f22a service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832744 Dec 14 03:32:43.313969 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:43.336420 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-b6720622-a580-4b5e-8fc3-dda6e5eb9226 service neutron] 10.222.0.20 "GET /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806870 Dec 14 03:32:43.339465 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1092a78c-17bc-467c-bcc6-09962007d4c8 None None] The sync data for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi is: [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:27:26Z', 'revision_number': 4, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi', '_interfaces': [{'id': '6f67ab90-b55b-45cb-9600-5ad87ca4c9a0', 'name': '', 'network_id': '1a26c104-e4b3-4523-972d-5602ee9f495b', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'mac_address': 'fa:16:3e:69:ff:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_interface', 'standard_attr_id': 675, 'fixed_ips': [{'subnet_id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:25Z', 'updated_at': '2021-12-14T03:27:30Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'subnets': [{'id': '451cc1f2-8364-4085-b29b-55aa3dffa6ca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:32:43.549407 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b5bd471-8ebe-4ae8-82c2-6c8095e543fc None None] New status for floating IP 413ddf2c-ec60-4647-a5da-730b829ca6b7: DOWN {{(pid=102574) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 14 03:32:44.179840 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c613836-2eda-4a04-8c58-43aefa8615f1 req-953a5115-0cdd-4769-9b09-3f9c94535d77 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:44.181260 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c613836-2eda-4a04-8c58-43aefa8615f1 req-953a5115-0cdd-4769-9b09-3f9c94535d77 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0466905 Dec 14 03:32:44.232932 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-4c613836-2eda-4a04-8c58-43aefa8615f1 req-fc6f880d-8037-4114-81cd-e17672b76899 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/security-groups?id=8a2644d2-6e17-4a79-bff4-f57fa2ca3787&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458498 Dec 14 03:32:44.693669 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30920794-f156-4429-8365-e35ed58448e6 req-578a75c4-3634-4de9-9711-918ad45d2a24 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102571) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 14 03:32:44.695156 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-30920794-f156-4429-8365-e35ed58448e6 req-578a75c4-3634-4de9-9711-918ad45d2a24 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.20 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 945 time: 0.0469902 Dec 14 03:32:44.779528 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Deleting port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:44.779877 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:45.108302 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] For port f5625fc9-aa99-4f98-9a5d-b0f54296bb68, host hv-cinder-81803, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81803',level=0,port_id=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:45.108666 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:45.120358 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling delete_port for f5625fc9-aa99-4f98-9a5d-b0f54296bb68 owned by compute:nova {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:45.242967 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:45.271090 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event deleted for resources: {'Port': ['ID=f5625fc9-aa99-4f98-9a5d-b0f54296bb68,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:45.314818 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] No DVR routers for this DVR port f5625fc9-aa99-4f98-9a5d-b0f54296bb68 on host hv-cinder-81803 {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:32:45.317410 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24952'] for port, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:45.321338 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-30920794-f156-4429-8365-e35ed58448e6 req-7c507371-389b-4831-842f-dada2244703c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.20 "DELETE /v2.0/ports/f5625fc9-aa99-4f98-9a5d-b0f54296bb68 HTTP/1.1" status: 204 len: 173 time: 0.6203718 Dec 14 03:32:45.327966 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-deleted', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68'}] {{(pid=102571) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 14 03:32:45.330144 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08a09f2cec675465262d2204d2f643f972757fee08d5865eacba16f0bee110a4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c01315c1-e7a5-4fdc-876c-408b91302718" -d '{"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-deleted", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]}' {{(pid=102571) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 14 03:32:45.351060 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [req-816facf5-51ba-41a7-8729-500310b318a8 req-c8cbb10b-8032-412c-8623-951703a0be91 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /v2.0/ports?device_id=ebdfbba3-0077-46f6-af60-35f085357682 HTTP/1.1" status: 200 len: 210 time: 0.0373490 Dec 14 03:32:45.372723 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 14 Dec 2021 03:32:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be1f3af8-c02b-409f-b880-87c74644ea7c x-openstack-request-id: req-be1f3af8-c02b-409f-b880-87c74644ea7c {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 14 03:32:45.373026 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-deleted", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68", "status": "completed", "code": 200}]} {{(pid=102571) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 14 03:32:45.373278 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-be1f3af8-c02b-409f-b880-87c74644ea7c {{(pid=102571) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 14 03:32:45.373671 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebdfbba3-0077-46f6-af60-35f085357682', 'name': 'network-vif-deleted', 'tag': 'f5625fc9-aa99-4f98-9a5d-b0f54296bb68', 'status': 'completed', 'code': 200} Dec 14 03:32:46.410610 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60190) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:46.468946 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:46.493471 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:46.550410 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:46.553091 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Publish callbacks [] for security_group, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:46.554210 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "DELETE /v2.0/security-groups/8a2644d2-6e17-4a79-bff4-f57fa2ca3787 HTTP/1.1" status: 204 len: 168 time: 0.1425927 Dec 14 03:32:46.564051 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339a37bb-3d53-49e2-b14f-ce5fd417f264 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a2644d2-6e17-4a79-bff4-f57fa2ca3787,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:46.602664 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60194) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:46.943987 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 no longer exists at agent hyperv_hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:46.962723 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] No Port match for: f5625fc9-aa99-4f98-9a5d-b0f54296bb68 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:46.963095 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Device f5625fc9-aa99-4f98-9a5d-b0f54296bb68 not bound to the agent host hv-cinder-81803 {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:47.033042 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:47.265326 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Deleting port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:47.265573 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:47.339227 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] For port 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:47.339609 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:47.350807 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Calling delete_port for 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 owned by network:router_interface {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:47.526713 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:47.551439 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Pushing event deleted for resources: {'Port': ['ID=6f67ab90-b55b-45cb-9600-5ad87ca4c9a0,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:47.716414 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:47.922409 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Router 6317f851-cf01-4746-8148-5f72c1fcc54f has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102571) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:32:48.022701 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102571) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:32:48.028288 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-57414b4a-472e-4b6b-a00c-730fc4c80949 admin admin] 10.222.0.43 "PUT /v2.0/routers/6317f851-cf01-4746-8148-5f72c1fcc54f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4245555 Dec 14 03:32:48.030812 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60198) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:48.032049 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Sync routers for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:32:48.042737 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:48.043401 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:48.133465 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks [] for router, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.146924 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: dv-cinder-818037-8-iscsi {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:48.228842 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.282680 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Deleting port ae4f0186-4093-4cec-ab04-4eca650cb512 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:48.283018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.321664 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:32:47Z', 'revision_number': 5, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port': {'id': 'ae4f0186-4093-4cec-ab04-4eca650cb512', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:92:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 674, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:24Z', 'updated_at': '2021-12-14T03:27:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:48.347908 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Checking router: 6317f851-cf01-4746-8148-5f72c1fcc54f for host: dv-cinder-818037-8-iscsi {{(pid=102573) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:32:48.357322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Routers {'6317f851-cf01-4746-8148-5f72c1fcc54f'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102573) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:48.357322 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['6317f851-cf01-4746-8148-5f72c1fcc54f'], 'active': True} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:48.360623 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] For port ae4f0186-4093-4cec-ab04-4eca650cb512, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=ae4f0186-4093-4cec-ab04-4eca650cb512,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:48.360987 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.373161 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Calling delete_port for ae4f0186-4093-4cec-ab04-4eca650cb512 owned by network:router_gateway {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:48.440464 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvr_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] Set router 6317f851-cf01-4746-8148-5f72c1fcc54f gateway port host: None {{(pid=102573) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:48.493160 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_hamode_db [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:32:48Z', 'revision_number': 6, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102573) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:48.522604 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cba16d1-1326-4c53-a3db-f3dc7c441641 None None] The sync data for ids ['6317f851-cf01-4746-8148-5f72c1fcc54f'] in dv-cinder-818037-8-iscsi is: [{'id': '6317f851-cf01-4746-8148-5f72c1fcc54f', 'name': 'tempest-TestShelveInstance-1226270651-router', 'tenant_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:23Z', 'updated_at': '2021-12-14T03:32:48Z', 'revision_number': 6, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'gw_port_host': None}] {{(pid=102573) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:32:48.539926 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.563504 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Pushing event deleted for resources: {'Port': ['ID=ae4f0186-4093-4cec-ab04-4eca650cb512,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:48.628236 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.717018 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.719114 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.760886 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.761440 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6317f851-cf01-4746-8148-5f72c1fcc54f {{(pid=102571) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:32:48.765765 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] Publish callbacks [] for router, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.767019 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-3a8705ec-d7b1-4645-bd25-00d200796ebd admin admin] 10.222.0.43 "DELETE /v2.0/routers/6317f851-cf01-4746-8148-5f72c1fcc54f HTTP/1.1" status: 204 len: 168 time: 0.7352629 Dec 14 03:32:48.769626 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60200) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:48.811488 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.db_base_plugin_v2 [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Deleting subnet 451cc1f2-8364-4085-b29b-55aa3dffa6ca {{(pid=102571) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:32:48.814417 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.850189 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8419048'] for subnet, precommit_delete_associations {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.936487 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:48.993127 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2036743', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-12477320'] for subnet, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.000104 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:49.016675 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=451cc1f2-8364-4085-b29b-55aa3dffa6ca,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:49.020803 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:49.021579 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 6f67ab90-b55b-45cb-9600-5ad87ca4c9a0 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:49.022173 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for subnet, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.025382 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-1bdef2e3-6ec5-4702-b5bf-5c217882352b admin admin] 10.222.0.43 "DELETE /v2.0/subnets/451cc1f2-8364-4085-b29b-55aa3dffa6ca HTTP/1.1" status: 204 len: 168 time: 0.2548563 Dec 14 03:32:49.028046 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.wsgi [-] (102571) accepted ('10.222.0.43', 60202) {{(pid=102571) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:49.030438 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03dcad9e-bbae-420b-88bd-7a5e4a9bada6 None None] Network 1a26c104-e4b3-4523-972d-5602ee9f495b requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:32:49.096029 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.148529 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Deleting port d2869f93-acef-4b08-8e27-7424b2cab322 {{(pid=102571) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:49.148859 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.211552 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.db [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] For port d2869f93-acef-4b08-8e27-7424b2cab322, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d2869f93-acef-4b08-8e27-7424b2cab322,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102571) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:49.211906 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.315676 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] DHCP port deletion for 1a26c104-e4b3-4523-972d-5602ee9f495b request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:32:49.366652 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Deleting port d2869f93-acef-4b08-8e27-7424b2cab322 {{(pid=102573) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:49.367205 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.434662 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.db [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] For port d2869f93-acef-4b08-8e27-7424b2cab322, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=d2869f93-acef-4b08-8e27-7424b2cab322,segment=NetworkSegment(87de8013-89e0-4dd5-a252-53fc717aecda),segment_id=87de8013-89e0-4dd5-a252-53fc717aecda)] {{(pid=102573) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:49.435069 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.448793 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Calling delete_port for d2869f93-acef-4b08-8e27-7424b2cab322 owned by network:dhcp {{(pid=102573) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:49.467422 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.plugin [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Calling delete_port for d2869f93-acef-4b08-8e27-7424b2cab322 owned by network:dhcp {{(pid=102571) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:49.532176 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996'] for port, after_delete {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.544508 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2036784'] for port, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.559080 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Pushing event deleted for resources: {'Port': ['ID=d2869f93-acef-4b08-8e27-7424b2cab322,revision_number=None']} {{(pid=102573) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:49.563836 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.db.l3_dvrscheduler_db [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] No DVR routers for this DVR port d2869f93-acef-4b08-8e27-7424b2cab322 on host dv-cinder-818037-8-iscsi {{(pid=102573) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:32:49.570652 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=d2869f93-acef-4b08-8e27-7424b2cab322,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:49.572086 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.572606 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.573115 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.573607 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.574098 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.574622 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] No DVR routers for this DVR port d2869f93-acef-4b08-8e27-7424b2cab322 on host dv-cinder-818037-8-iscsi {{(pid=102571) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:32:49.574850 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.575360 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.575851 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.576350 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.576865 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.578376 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.578931 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.579459 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-606b5a4d-a938-47bc-b5f2-92e3462c5a7c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102573) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:49.649965 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.669707 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1a26c104-e4b3-4523-972d-5602ee9f495b']}} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:49.678853 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '87de8013-89e0-4dd5-a252-53fc717aecda') {'for_net_delete': True} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:49.679705 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.services.segments.db [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '87de8013-89e0-4dd5-a252-53fc717aecda') {} {{(pid=102571) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:49.688683 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8418835'] for segment, before_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.702534 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.708748 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Releasing vlan 295 on physical network physnet1 to pool {{(pid=102571) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:32:49.709131 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2036845'] for segment, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self.session.flush() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self.session.flush() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self.session.flush() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self.session.flush() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: Traceback (most recent call last): Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: timer() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: cb(*args, **kw) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: return func(*args, **kwargs) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self._notify() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: self.callback(batched_events) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: event.method(event) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: return f(self, *a, **k) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._get(url).json() Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: return self.request(url, 'GET', **kwargs) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:32:49.710967 dv-cinder-818037-8-iscsi neutron-server[102571]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:32:49.720328 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d15cfe65-68d7-42a6-a7df-db3168582022 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.768731 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.773179 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron_lib.callbacks.manager [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102571) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:49.776470 dv-cinder-818037-8-iscsi neutron-server[102571]: INFO neutron.wsgi [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] 10.222.0.43 "DELETE /v2.0/networks/1a26c104-e4b3-4523-972d-5602ee9f495b HTTP/1.1" status: 204 len: 168 time: 0.7473569 Dec 14 03:32:49.779494 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60204) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:49.789374 dv-cinder-818037-8-iscsi neutron-server[102571]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36fb92f-4bff-4c6f-b63c-6dccfd0899c3 admin admin] Pushing event deleted for resources: {'Network': ['ID=1a26c104-e4b3-4523-972d-5602ee9f495b,revision_number=None']} {{(pid=102571) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:50.110228 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3727647'] for router_interface, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:50.343233 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Deleting port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:50.343577 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:50.422162 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] For port fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:50.422414 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:50.433800 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Calling delete_port for fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa owned by network:router_interface {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:50.605730 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:50.634648 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Pushing event deleted for resources: {'Port': ['ID=fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:50.663032 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.663418 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.663762 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.664102 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.664438 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.664769 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.665098 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.665428 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.665754 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.666082 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.666407 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.666730 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.667066 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-818037-8-iscsi {{(pid=102572) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 14 03:32:50.807201 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3715150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3727747'] for router_interface, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:50.962769 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d2869f93-acef-4b08-8e27-7424b2cab322 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:50.984290 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: d2869f93-acef-4b08-8e27-7424b2cab322 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:50.984635 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device d2869f93-acef-4b08-8e27-7424b2cab322 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:50.985047 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ae4f0186-4093-4cec-ab04-4eca650cb512 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:51.004577 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: ae4f0186-4093-4cec-ab04-4eca650cb512 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:51.004930 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device ae4f0186-4093-4cec-ab04-4eca650cb512 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:51.284167 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Router 4df6906c-be31-42f3-9234-a36bd03a3198 has already been hosted by L3 agent 1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4 {{(pid=102572) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 14 03:32:51.382609 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] Notify agent at l3_agent.dv-cinder-818037-8-iscsi the message routers_updated {{(pid=102572) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 14 03:32:51.387831 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-a57d158a-b519-4d65-be88-35c831c286da admin admin] 10.222.0.43 "PUT /v2.0/routers/4df6906c-be31-42f3-9234-a36bd03a3198/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6072536 Dec 14 03:32:51.390393 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60208) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:51.393765 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Sync routers for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 14 03:32:51.403111 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:51.403728 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:51.491420 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks [] for router, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.515073 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: dv-cinder-818037-8-iscsi {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:51.590550 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.643415 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Deleting port c3a67507-30b1-478f-99d6-330b5442370f {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:51.643906 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.692111 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'external_fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248'}], 'enable_snat': True}, 'gw_port_id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:32:50Z', 'revision_number': 5, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port': {'id': 'c3a67507-30b1-478f-99d6-330b5442370f', 'name': '', 'network_id': 'd05a17b1-467e-47d1-82d5-54575b429fe9', 'tenant_id': '', 'mac_address': 'fa:16:3e:7d:45:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'device_owner': 'network:router_gateway', 'standard_attr_id': 686, 'fixed_ips': [{'subnet_id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'ip_address': '172.27.3.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-818037-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:27:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4cd56c41-a067-4663-888d-62ea7a6d5a3d', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-818037-8-iscsi'}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:51.718217 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Checking router: 4df6906c-be31-42f3-9234-a36bd03a3198 for host: dv-cinder-818037-8-iscsi {{(pid=102574) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 14 03:32:51.722974 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] For port c3a67507-30b1-478f-99d6-330b5442370f, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=c3a67507-30b1-478f-99d6-330b5442370f,segment=NetworkSegment(9f88eb15-2764-4f4a-bab3-999e2902629a),segment_id=9f88eb15-2764-4f4a-bab3-999e2902629a)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:51.723356 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.726703 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Routers {'4df6906c-be31-42f3-9234-a36bd03a3198'} bound to L3 agent in host dv-cinder-818037-8-iscsi {{(pid=102574) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 14 03:32:51.727339 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-818037-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-14T03:06:52Z,description=,heartbeat_timestamp=2021-12-14T03:32:22Z,host='dv-cinder-818037-8-iscsi',id=1fe9fc4b-b1cc-4519-9aca-3c5da24e95c4,load=0,resource_versions=,resources_synced=,started_at=2021-12-14T03:06:52Z,topic='l3_agent')) {'router_ids': ['4df6906c-be31-42f3-9234-a36bd03a3198'], 'active': True} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:51.735158 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Calling delete_port for c3a67507-30b1-478f-99d6-330b5442370f owned by network:router_gateway {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:51.816022 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_dvr_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] Set router 4df6906c-be31-42f3-9234-a36bd03a3198 gateway port host: None {{(pid=102574) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 14 03:32:51.866988 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.l3_hamode_db [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:32:51Z', 'revision_number': 6, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port_host': None}], 'dv-cinder-818037-8-iscsi', False) {} {{(pid=102574) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:51.894302 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.897400 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-475d4dca-acd4-4167-9dc2-d24cc2156319 None None] The sync data for ids ['4df6906c-be31-42f3-9234-a36bd03a3198'] in dv-cinder-818037-8-iscsi is: [{'id': '4df6906c-be31-42f3-9234-a36bd03a3198', 'name': 'tempest-TestShelveInstance-691376641-router', 'tenant_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-14T03:27:28Z', 'updated_at': '2021-12-14T03:32:51Z', 'revision_number': 6, 'project_id': '32ff09be74fb44fa9cd1bba92f63f7d6', 'gw_port_host': None}] {{(pid=102574) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 14 03:32:51.899431 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-6f8b6a74-6f85-4385-bbec-b1fe571a1f86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:51.920705 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Pushing event deleted for resources: {'Port': ['ID=c3a67507-30b1-478f-99d6-330b5442370f,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:51.981907 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3728673'] for router_gateway, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.067148 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3729841', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7265'] for router, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.069202 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.113203 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3729848'] for router, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.113840 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4df6906c-be31-42f3-9234-a36bd03a3198 {{(pid=102572) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 14 03:32:52.118622 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] Publish callbacks [] for router, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.119769 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-af9a7297-2fcb-4869-975b-40ec4f312462 admin admin] 10.222.0.43 "DELETE /v2.0/routers/4df6906c-be31-42f3-9234-a36bd03a3198 HTTP/1.1" status: 204 len: 168 time: 0.7284658 Dec 14 03:32:52.122254 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60210) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:52.165132 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.db_base_plugin_v2 [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Deleting subnet 01f6283a-0b59-40c4-9ff4-b4af3a4e47b9 {{(pid=102572) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 14 03:32:52.168111 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.200169 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-12513715'] for subnet, precommit_delete_associations {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.278727 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3487673'] for subnet, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.330074 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3487666', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440325', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-12248285', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8547487'] for subnet, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.356335 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=01f6283a-0b59-40c4-9ff4-b4af3a4e47b9,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:52.358256 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.361430 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-f3ebab08-533d-42c6-a37f-efbf994d811c admin admin] 10.222.0.43 "DELETE /v2.0/subnets/01f6283a-0b59-40c4-9ff4-b4af3a4e47b9 HTTP/1.1" status: 204 len: 168 time: 0.2382624 Dec 14 03:32:52.362814 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73a0dd52-2da0-4053-afda-e76e153d98c6 None None] Network c1c22778-60af-4c9e-bdc7-44a03effc217 requested from dv-cinder-818037-8-iscsi {{(pid=102573) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 14 03:32:52.363902 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60212) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:52.432764 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3638423'] for network, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.486330 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Deleting port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 {{(pid=102572) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 14 03:32:52.486664 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8763912219504'] for port, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.546089 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.db [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] For port 5f511d88-c260-4310-b3bb-2dbc76fdbc08, host dv-cinder-818037-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-818037-8-iscsi',level=0,port_id=5f511d88-c260-4310-b3bb-2dbc76fdbc08,segment=NetworkSegment(212df66f-d62f-470a-893b-f4b1c778096e),segment_id=212df66f-d62f-470a-893b-f4b1c778096e)] {{(pid=102572) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 14 03:32:52.546440 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-493706'] for port, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.559241 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.plugin [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Calling delete_port for 5f511d88-c260-4310-b3bb-2dbc76fdbc08 owned by network:dhcp {{(pid=102572) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 14 03:32:52.640549 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-578233', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-235074', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8763912258771', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8763911691996', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-12248298'] for port, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.653854 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36cb9aaf-4884-42e5-8c1a-2d81145a80df None None] DHCP port deletion for c1c22778-60af-4c9e-bdc7-44a03effc217 request from dv-cinder-818037-8-iscsi {{(pid=102573) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 14 03:32:52.672076 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Pushing event deleted for resources: {'Port': ['ID=5f511d88-c260-4310-b3bb-2dbc76fdbc08,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:52.673928 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] No DVR routers for this DVR port 5f511d88-c260-4310-b3bb-2dbc76fdbc08 on host dv-cinder-818037-8-iscsi {{(pid=102572) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 14 03:32:52.747487 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3484718', 'neutron.services.segments.db._delete_segments_for_network-8763912245634'] for network, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.769083 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c1c22778-60af-4c9e-bdc7-44a03effc217']}} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:52.778158 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '212df66f-d62f-470a-893b-f4b1c778096e') {'for_net_delete': True} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:52.778454 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.services.segments.db [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '212df66f-d62f-470a-893b-f4b1c778096e') {} {{(pid=102572) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 14 03:32:52.787499 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8763912245899', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-12513608'] for segment, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.800403 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048'] for segment, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.813033 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Releasing vlan 285 on physical network physnet1 to pool {{(pid=102572) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 14 03:32:52.813555 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3488048', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-12248247'] for segment, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: Traceback (most recent call last): Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: timer() Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: cb(*args, **kw) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: return func(*args, **kwargs) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: self._notify() Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: self.callback(batched_events) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: event.method(event) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: aggregate_uuid = self.p_client.list_aggregates( Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: return f(self, *a, **k) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._get(url).json() Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: return self.request(url, 'GET', **kwargs) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: base_url = self.get_endpoint(auth, allow=allow, Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 14 03:32:52.817042 dv-cinder-818037-8-iscsi neutron-server[102572]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 14 03:32:52.872333 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3484711', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411453', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3715191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3728653'] for network, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.877810 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3715177'] for network, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:52.881065 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] 10.222.0.43 "DELETE /v2.0/networks/c1c22778-60af-4c9e-bdc7-44a03effc217 HTTP/1.1" status: 204 len: 168 time: 0.5159812 Dec 14 03:32:52.892119 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b7f931-a5ea-4a3f-9d21-95a973ef13b4 admin admin] Pushing event deleted for resources: {'Network': ['ID=c1c22778-60af-4c9e-bdc7-44a03effc217,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:52.947475 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 5f511d88-c260-4310-b3bb-2dbc76fdbc08 no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:52.967353 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: 5f511d88-c260-4310-b3bb-2dbc76fdbc08 {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:52.967693 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device 5f511d88-c260-4310-b3bb-2dbc76fdbc08 not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:52.968096 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:52.981440 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:32:52.987168 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:52.987518 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device fe0f5c5e-7c1b-48d7-a3a0-82c7a4df5cfa not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:52.987921 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c3a67507-30b1-478f-99d6-330b5442370f no longer exists at agent ovs-agent-dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 14 03:32:53.005934 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60216) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:53.007068 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.plugin [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] No Port match for: c3a67507-30b1-478f-99d6-330b5442370f {{(pid=102573) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 14 03:32:53.007470 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron.plugins.ml2.rpc [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Device c3a67507-30b1-478f-99d6-330b5442370f not bound to the agent host dv-cinder-818037-8-iscsi {{(pid=102573) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 14 03:32:53.045521 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-46141b88-aca8-43ef-a0ca-1c7df3ce0e61 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=84ffd96b68cf41c5a9be418ed8c0c61a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384171 Dec 14 03:32:53.048075 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60218) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:53.096934 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.118131 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.160526 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.163197 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.164831 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e96db4ed-0618-4db3-a351-bc156ef4fad7 HTTP/1.1" status: 204 len: 168 time: 0.1158695 Dec 14 03:32:53.172037 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9182b9-73a3-4dc9-be25-540c34e4252e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e96db4ed-0618-4db3-a351-bc156ef4fad7,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:53.469094 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60224) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:53.507850 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-e9070cd7-f8b1-4d31-b7a4-cda677a36788 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=32ff09be74fb44fa9cd1bba92f63f7d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0376031 Dec 14 03:32:53.510222 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.wsgi [-] (102572) accepted ('10.222.0.43', 60226) {{(pid=102572) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 14 03:32:53.555064 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.575183 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.619351 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-411502'] for security_group, after_delete {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.621864 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron_lib.callbacks.manager [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102572) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:53.622970 dv-cinder-818037-8-iscsi neutron-server[102572]: INFO neutron.wsgi [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0d02ee18-3e7f-4560-b3cb-65fd72301917 HTTP/1.1" status: 204 len: 168 time: 0.1118779 Dec 14 03:32:53.631944 dv-cinder-818037-8-iscsi neutron-server[102572]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ebf705-4505-48db-8370-a333bd55e825 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d02ee18-3e7f-4560-b3cb-65fd72301917,revision_number=None']} {{(pid=102572) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 14 03:32:53.667463 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:54.668113 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:32:55.830676 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:11.464348 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:19.721787 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-7a2995a2-1da7-45b5-907f-15819fdba08d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:21.903646 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b0e9f78b-d16d-409e-95d3-4ac796f1fc6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:23.656130 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:24.671682 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:25.832344 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:29.983354 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:33:41.467909 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:49.723641 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-406b9d57-ab1a-424e-8be5-c071645ce676 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:51.904420 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e1c05ec3-7c01-48e8-834c-3ceadda6ae44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:53.657722 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:54.673852 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:33:55.835117 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:06.982547 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:34:11.477690 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:19.726642 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-11130505-3dbf-4509-bebb-7fdb82d204d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:21.907773 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d54c9ac9-6f5f-416f-ad8a-53cb06327f3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:23.661552 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:24.682603 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:25.838178 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:41.492025 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:43.981685 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:34:49.727218 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b16272e7-35ea-45dc-84a3-38f02e15edaa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:51.909091 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-e8e43b22-67b7-4bc8-b576-459035408d3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:53.663610 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:54.679238 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:34:55.840497 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:11.497234 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:19.728681 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-4fc7829a-ef81-4dce-8ea7-2fe1c391a318 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:20.980990 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:35:21.910662 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-bae166a4-283d-4363-8177-259ea55012dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:23.665511 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:24.682589 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:25.842706 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:41.516062 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:49.730193 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-1950cb8f-838d-482e-b536-2847f99b17d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:51.912103 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d840d4ad-8854-4980-a9e7-98c703b036b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:53.669589 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:54.684618 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:55.844329 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:35:57.980118 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:36:11.514558 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:19.732096 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ecd6beb0-f989-4788-aea8-f7c22b060129 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:21.913468 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-f5f72d3c-2754-4a0f-bc52-21bdacf3e47b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:23.671484 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:24.687146 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:25.845906 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:34.979481 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:36:41.519142 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:49.733477 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-5a7bfd48-6f84-4fb2-af30-adf302ff28fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:51.915959 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ee8cb389-d425-44ed-8472-d935a38edaba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:53.675155 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:54.688551 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:36:55.847738 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:11.526063 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:11.978806 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:37:19.734946 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-05114587-727b-4e34-9ee9-a1892dbe0dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:21.917434 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-a70e72e6-a4eb-40c5-8cbe-28bdfa52a4fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:23.677458 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:24.690576 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:25.849579 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:41.516315 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:48.977264 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 14 03:37:49.736343 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2bcda73d-59a5-4bba-9753-19b8adbaee22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:51.918803 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b6e4856b-ea9a-4d9b-b53a-e17a36451e83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:53.681241 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:54.693645 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:37:55.851166 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:11.515320 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-b5bddfa2-7cc5-4473-9311-f5ac6512c218 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:19.736838 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-8b10f561-3f79-4894-a291-3e7c92db5d9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:21.920801 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-afa57d28-8f39-4586-8de6-20f2975583aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:23.685437 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-d9eb5991-1426-43c6-8a05-3ff7f378c013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:24.696964 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-2fd7eb00-1c4c-431b-be0f-1729fccf8f9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:25.857945 dv-cinder-818037-8-iscsi neutron-server[102573]: DEBUG neutron_lib.callbacks.manager [None req-ac24aa14-f7f7-490e-bc21-fab103417745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8763912245589', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3482872'] for agent, after_update {{(pid=102573) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 14 03:38:25.976316 dv-cinder-818037-8-iscsi neutron-server[102574]: DEBUG neutron.db.agents_db [None req-c35604b5-e22b-44c5-9992-0873949d0856 None None] Agent healthcheck: found 6 active agents {{(pid=102574) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}